2026-11-03T13:17:54.746177Z info FLAG: --concurrency="0" 2026-11-03T13:17:54.746197Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T13:17:54.746201Z info FLAG: --help="false" 2026-11-03T13:17:54.746203Z info FLAG: --log_as_json="false" 2026-11-03T13:17:54.746206Z info FLAG: --log_caller="" 2026-11-03T13:17:54.746208Z info FLAG: --log_output_level="default:info" 2026-11-03T13:17:54.746210Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T13:17:54.746214Z info FLAG: --log_target="[stdout]" 2026-11-03T13:17:54.746217Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T13:17:54.746219Z info FLAG: --outlierLogPath="" 2026-11-03T13:17:54.746221Z info FLAG: --profiling="true" 2026-11-03T13:17:54.746223Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T13:17:54.746225Z info FLAG: --proxyLogLevel="warning" 2026-11-03T13:17:54.746227Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T13:17:54.746229Z info FLAG: --stsPort="0" 2026-11-03T13:17:54.746231Z info FLAG: --templateFile="" 2026-11-03T13:17:54.746233Z info FLAG: --tokenManagerPlugin="" 2026-11-03T13:17:54.746235Z info FLAG: --vklog="0" 2026-11-03T13:17:54.746238Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T13:17:54.746411Z info Proxy role ips=[10.133.0.55] type=router id=maas-default-gateway-openshift-default-84587756dc-z544g.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T13:17:54.746461Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T13:17:54.747625Z info cpu limit detected as 2, setting concurrency 2026-11-03T13:17:54.748190Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T13:17:54.748203Z info JWT policy is third-party-jwt 2026-11-03T13:17:54.748206Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T13:17:54.749525Z info Starting default Istio SDS Server 2026-11-03T13:17:54.749547Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T13:17:54.749570Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T13:17:54.749944Z info Opening status port 15020 2026-11-03T13:17:54.750758Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T13:17:54.751437Z info sds Starting SDS grpc server 2026-11-03T13:17:54.751473Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T13:17:54.752095Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T13:17:54.752902Z info Starting proxy agent 2026-11-03T13:17:54.752941Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T13:17:54.815782Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T13:17:54.915049Z info ads ADS: new connection for node:1 2026-11-03T13:17:54.915503Z info ads ADS: new connection for node:2 2026-11-03T13:17:54.999490Z info cache generated new workload certificate resourceName=default latency=247.946765ms ttl=23h59m59.000515218s 2026-11-03T13:17:54.999523Z info cache Root cert has changed, start rotating root cert 2026-11-03T13:17:54.999563Z info cache returned workload trust anchor from cache ttl=23h59m59.000438206s 2026-11-03T13:17:54.999581Z info cache returned workload certificate from cache ttl=23h59m59.000420037s 2026-11-03T13:17:54.999665Z info cache returned workload trust anchor from cache ttl=23h59m59.000338357s 2026-11-03T13:17:54.999908Z info cache returned workload trust anchor from cache ttl=23h59m59.000092292s 2026-11-03T13:17:55.080328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:18:02.938957Z info Readiness succeeded in 8.195036607s 2026-11-03T13:18:02.939278Z info Envoy proxy is ready [2026-11-03T13:18:15.473Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 44 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "011d3f8d-0f06-496b-a488-14909d70540b" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.55:443 10.132.0.13:37368 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:18:18.019871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:18:18.019912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:18:18.019927Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:18:18.019932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T13:18:18.835160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:18:18.835191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:18:18.835205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T13:18:18.835210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T13:18:17.950Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 69 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "174b9109-2f91-469e-b27c-6575c88a5ce3" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:39774 10.133.0.55:443 10.132.0.13:37392 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T13:18:18.739Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 96 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "639e40c0-8452-449b-a933-cd92f228efc6" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:39774 10.133.0.55:443 10.132.0.13:37396 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:18:19.250084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:18:19.250119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:18:19.250132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T13:18:19.250137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T13:18:19.190Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 60 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "8099a2ed-6760-4cbf-b7b1-af20e3281648" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:39774 10.133.0.55:443 10.132.0.13:37400 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T13:18:19.433Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 38 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "52afc1d2-2651-4243-b45b-17e5e18d9ace" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.55:443 10.132.0.13:37404 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:18:37.022132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:18:40.268716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:18:57.070800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:18:57.070843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:18:57.070857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:18:57.070863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T13:18:57.002Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 312 68 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "31911617-d727-4ebb-9d8d-889cd1a78e48" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:39774 10.133.0.55:443 10.132.0.13:52450 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T13:20:27.344Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 2568 99 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "cd689fb1-5e2c-4327-8e5a-c0c5ecc2a1a8" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.55:49132 10.133.0.55:443 10.132.0.13:50908 - v1-chat-completions-path 2026-11-03T13:21:43.673068Z info ads ADS: new connection for node:3 2026-11-03T13:21:43.682656Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T13:21:43.682722Z info cache read certificate from file resource=file-root:system 2026-11-03T13:28:56.442294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:29:08.624996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:29:27.910497Z info ads ADS: new connection for node:4 2026-11-03T13:29:27.911720Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T13:29:27.911815Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T13:29:56.559081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:30:36.036956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:31:04.494361Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:31:32.013935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:31:36.564853Z info ads ADS: "" 4 terminated 2026-11-03T13:31:49.062958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:31:49.062994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:31:49.063004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:31:49.063009Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T13:31:49.063172Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T13:31:48.992Z] "POST /llm/e2e-rt-sw-2ece70/anything/e2e-rt-sw-2ece70-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 70 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "6cb83431-92db-49d0-a38a-8b0152e4e6d9" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-2ece70.llm.svc.cluster.local - 10.133.0.55:443 10.132.0.13:48856 - llm.external-model-e2e-rt-sw-2ece70-8a582f45b424.2 2026-11-03T13:31:55.465988Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:32:12.202163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:32:36.764537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:33:02.973358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:34:41.938548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:35:15.016322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:35:31.384628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:35:53.340868Z info ads ADS: "" 3 terminated 2026-11-03T13:36:34.524150Z info ads ADS: new connection for node:5 2026-11-03T13:36:34.529385Z info cache read certificate from file resource=file-root:system 2026-11-03T13:37:18.821906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:38:08.328487Z info ads ADS: "" 5 terminated with stream closed 2026-11-03T13:39:04.946231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:42:23.324225Z info ads ADS: new connection for node:6 2026-11-03T13:42:23.346433Z info cache read certificate from file resource=file-root:system 2026-11-03T13:44:21.181766Z info ads ADS: "" 6 terminated 2026-11-03T13:46:09.469929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:46:20.536375Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T13:46:33.888556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:48:15.890198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:48:15.890233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:48:15.890248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T13:48:15.890252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T13:48:15.824Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 65 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "4197f1e0-bb47-4eaf-a61b-a17ce22a3f57" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:36754 10.133.0.55:443 10.132.0.13:58200 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:48:35.705527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T13:48:38.200Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 294 485 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "c9f54c06-0f9b-45aa-8438-fdc18739f5a0" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.55:55932 10.133.0.55:443 10.132.0.13:34056 - v1-completions-path 2026-11-03T13:48:50.964701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:48:52.622439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:49:02.567186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:49:05.906912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:49:09.431331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:49:24.735503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:49:44.666240Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:49:54.890138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:50:05.187076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:50:07.852836Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-03T13:50:15.534721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:50:25.657862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:50:35.881626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:50:46.100298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:50:56.279259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:51:06.461210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:51:16.693559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:51:54.125840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:52:10.053060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:52:11.728767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:52:14.590421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:52:14.590460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:52:14.590480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T13:52:14.590487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T13:52:14.070Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 520 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "1cfd090f-1bd8-4f3f-b6d0-4ebc17af725a" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:37000 10.133.0.55:443 10.132.0.13:48164 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:52:17.536386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:52:21.068105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T13:52:21.069443Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T13:52:20.989Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 80 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "cb3373fb-d5be-46e9-88f6-a79d76c16ff8" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.55:44068 10.133.0.55:443 10.132.0.13:57546 - v1-catch-all-path 2026-11-03T13:52:33.027017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:52:34.638649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:52:49.208376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:52:59.961357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:53:01.641668Z info ads ADS: new connection for node:7 2026-11-03T13:53:01.641883Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T13:53:02.894381Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:53:43.815943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T13:54:01.816Z] "POST /v1/chat/completions HTTP/1.1" 403 - - "-" 131 0 38 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "9bb734b2-88fa-4082-8a77-e21904d875c2" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|54321||e2e-prio-pool-d2dab122-inference-pool-ip-05c05bdc.llm.svc.cluster.local - 10.133.0.55:443 10.132.0.13:33626 - v1-model-routing 2026-11-03T13:54:02.800915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:54:03.318854Z info ads ADS: "" 7 terminated with stream closed 2026-11-03T13:54:04.591839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:54:07.702138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:54:11.690951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:54:23.796638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:54:40.478259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:54:56.759502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:55:08.398843Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:55:12.202025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:55:20.337989Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:55:22.947308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T13:55:26.128Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 81 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "bc86e23d-c675-4591-a229-8309fa9ebbeb" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.55:37768 10.133.0.55:443 10.132.0.13:60004 - v1-completions-path 2026-11-03T13:55:38.588156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:56:57.071243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T13:56:56.999Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 316 72 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "08f0582d-da38-4926-a5b1-1a1f43501ad5" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.55:51786 10.133.0.55:443 10.132.0.13:44214 - v1-chat-completions-path 2026-11-03T13:59:40.797061Z info ads ADS: new connection for node:8 2026-11-03T13:59:40.802268Z info cache read certificate from file resource=file-root:system 2026-11-03T13:59:41.472729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:59:42.909602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:01:26.682632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:01:26.808557Z info ads ADS: "" 8 terminated 2026-11-03T14:01:27.206030Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T14:01:27.206054Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T14:01:27.206057Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T14:01:27.206061Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T14:01:27.166Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 39 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "8e8240ab-6003-4c6b-9bfc-90aa7cad3f3b" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.55:443 10.132.0.13:35572 - v1-completions-path 2026-11-03T14:01:28.362540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:01:31.435056Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:01:43.406308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:01:45.284328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:01:47.965269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:01:56.625999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:02:02.448290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:02:02.448327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:02:02.448360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T14:02:02.448366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T14:02:02.361Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 86 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "7b69fc54-1ab9-4f6d-8a6d-be64f1f6efee" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:35364 10.133.0.55:443 10.132.0.13:36646 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T14:02:21.386256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:02:31.628308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:02:33.322086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:02:38.981259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:02:38.981295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:02:38.981311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:02:38.981316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T14:02:38.894Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 86 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "cea54293-dbbe-4519-afb1-0a08e9438a4e" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:54606 10.133.0.55:443 10.132.0.13:38530 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T14:02:52.304559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:02:54.017661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:02:59.873702Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T14:03:08.732Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 63 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "87dc7761-f025-4125-8657-638ab0edb605" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.55:51786 10.133.0.55:443 10.132.0.13:38988 - v1-completions-path 2026-11-03T14:03:10.790528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:03:24.470134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:03:26.055077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:03:31.714025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:03:49.803951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:03:52.427694Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:04:05.205445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:04:07.342496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:04:11.819222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:04:30.156639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:04:40.386555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T14:04:55.265Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 42 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "facf84db-c062-4da5-92c4-c2ee6964f066" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.55:443 10.132.0.13:36668 - v1-completions-path 2026-11-03T14:04:56.892389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:04:59.830721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:06:46.479814Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-03T14:07:02.379926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:07:02.379960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:07:02.379975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:07:02.379980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T14:07:02.306Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 73 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "0f81a274-09cf-4d55-bd27-6660d493aff7" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:36236 10.133.0.55:443 10.132.0.13:36900 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T14:07:14.444248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:07:17.479583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:07:19.667448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:07:34.829273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:07:45.002804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:08:04.979712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:11:40.703548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:11:45.116045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:11:47.818039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:11:47.818077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:11:47.818094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:11:47.818099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T14:11:47.544Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 314 274 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "cdb7cecb-fc9a-45b9-9ac1-0ca65055951e" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.1.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:37090 10.133.0.55:443 10.132.0.13:46376 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T14:11:48.229Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "e461e66a-c77b-42b4-b746-43eb91ce91fa" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.55:46598 10.133.0.55:443 10.132.0.13:46382 - v1-completions-path 2026-11-03T14:11:49.704328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:11:49.704403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:11:49.704421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:11:49.704427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T14:11:49.640Z] "DELETE /v1/api-keys/0c17ac13-c5d4-4953-be26-638fb870c9bf HTTP/1.1" 200 - via_upstream - "-" 0 369 64 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "2c8033ac-3486-4e39-a4f4-0666916c94e8" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.245:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.55:49262 10.133.0.55:443 10.132.0.13:46390 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T14:12:01.282334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:12:11.431283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:12:14.747160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:12:33.372260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:12:35.536187Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:12:38.816046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T14:12:42.562Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 67 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "0c4b37b7-b8f4-4251-88ad-798def8c901d" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.55:37768 10.133.0.55:443 10.132.0.13:40248 - v1-completions-path [2026-11-03T14:12:45.572Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 61 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "609c3888-54d0-4e92-a9e4-0d7543c7bab3" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.55:37768 10.133.0.55:443 10.132.0.13:51102 - v1-completions-path [2026-11-03T14:12:46.084Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "6a19bb03-3261-41e7-9ba3-adbe59cd82d9" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.55:37768 10.133.0.55:443 10.132.0.13:51110 - v1-completions-path 2026-11-03T14:12:59.595917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:13:09.900281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:13:12.086514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:13:15.452201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:13:23.534860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:13:42.223517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:13:52.399068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8