2026-10-30T03:33:58.097590Z info FLAG: --concurrency="0" 2026-10-30T03:33:58.097615Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T03:33:58.097621Z info FLAG: --help="false" 2026-10-30T03:33:58.097625Z info FLAG: --log_as_json="false" 2026-10-30T03:33:58.097628Z info FLAG: --log_caller="" 2026-10-30T03:33:58.097632Z info FLAG: --log_output_level="default:info" 2026-10-30T03:33:58.097635Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T03:33:58.097643Z info FLAG: --log_target="[stdout]" 2026-10-30T03:33:58.097647Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T03:33:58.097650Z info FLAG: --outlierLogPath="" 2026-10-30T03:33:58.097654Z info FLAG: --profiling="true" 2026-10-30T03:33:58.097657Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T03:33:58.097660Z info FLAG: --proxyLogLevel="warning" 2026-10-30T03:33:58.097663Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T03:33:58.097666Z info FLAG: --stsPort="0" 2026-10-30T03:33:58.097669Z info FLAG: --templateFile="" 2026-10-30T03:33:58.097672Z info FLAG: --tokenManagerPlugin="" 2026-10-30T03:33:58.097677Z info FLAG: --vklog="0" 2026-10-30T03:33:58.097681Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T03:33:58.097872Z info Proxy role ips=[10.132.0.59] type=router id=maas-default-gateway-openshift-default-64d4cc998c-c6m27.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T03:33:58.097967Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T03:33:58.099712Z info cpu limit detected as 2, setting concurrency 2026-10-30T03:33:58.100048Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T03:33:58.100064Z info JWT policy is third-party-jwt 2026-10-30T03:33:58.100068Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T03:33:58.101804Z info Starting default Istio SDS Server 2026-10-30T03:33:58.101830Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T03:33:58.101862Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T03:33:58.102307Z info Opening status port 15020 2026-10-30T03:33:58.103487Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T03:33:58.104057Z info sds Starting SDS grpc server 2026-10-30T03:33:58.104102Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T03:33:58.104756Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T03:33:58.105866Z info Starting proxy agent 2026-10-30T03:33:58.105897Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T03:33:58.177137Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T03:33:58.262446Z info cache generated new workload certificate resourceName=default latency=158.257167ms ttl=23h59m59.737559152s 2026-10-30T03:33:58.262490Z info cache Root cert has changed, start rotating root cert 2026-10-30T03:33:58.262534Z info cache returned workload trust anchor from cache ttl=23h59m59.737467801s 2026-10-30T03:33:58.309981Z info ads ADS: new connection for node:1 2026-10-30T03:33:58.310033Z info ads ADS: new connection for node:2 2026-10-30T03:33:58.310058Z info cache returned workload certificate from cache ttl=23h59m59.689944965s 2026-10-30T03:33:58.310119Z info cache returned workload trust anchor from cache ttl=23h59m59.689882315s 2026-10-30T03:33:58.404416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:34:06.610403Z info Readiness succeeded in 8.516096774s 2026-10-30T03:34:06.610704Z info Envoy proxy is ready 2026-10-30T03:40:31.290408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:40:51.651794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:42:42.191181Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:43:44.494504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T03:44:56.702Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 166 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "2afc61a9-a24f-4183-888e-aa905390db0f" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.59:443 10.132.0.20:45806 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T03:44:57.839798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:44:57.839845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:44:57.839864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:44:57.839871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T03:44:57.703Z] "DELETE /v1/api-keys/73de8cba-27d3-4451-8ac2-59f2f688f86d HTTP/1.1" 200 - via_upstream - "-" 0 321 136 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "89beed11-0c98-431d-8223-f319c4531dcc" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:56090 10.132.0.59:443 10.132.0.20:36158 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T03:44:58.948513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:44:58.948551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:44:58.948566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:44:58.948571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T03:44:58.837Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 111 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "c8164445-928e-41b8-8d6e-19832410ee0d" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:56100 10.132.0.59:443 10.132.0.20:36168 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T03:44:59.680821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:44:59.680854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:44:59.680867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:44:59.680872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T03:44:59.940914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:44:59.941041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:44:59.941090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T03:44:59.941119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T03:44:59.602Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 78 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "f1cf5e46-2071-4504-803a-7d08fd838fc5" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:56090 10.132.0.59:443 10.132.0.20:36176 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T03:44:59.803Z] "DELETE /v1/api-keys/a19261ef-2dbe-4996-bc6e-9f4ec516e8a3 HTTP/1.1" 200 - via_upstream - "-" 0 321 137 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "88b2ebcd-ab3f-4f5b-a3fa-33662226df9b" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:56100 10.132.0.59:443 10.132.0.20:36192 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T03:45:00.579Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 203 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "39cf02e8-da76-4418-97ec-a1ba50fad0b8" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.59:443 10.132.0.20:36202 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T03:45:01.807058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:45:01.807156Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:45:01.807199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:45:01.807223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T03:45:01.978659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:45:01.978696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:45:01.978709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:45:01.978714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T03:45:01.382Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 424 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3cd944e0-4f81-4c55-bab4-8b911f29c935" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:56090 10.132.0.59:443 10.132.0.20:36210 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T03:45:01.832Z] "DELETE /v1/api-keys/48f2dda4-e1f6-4650-a9f5-9e720910a973 HTTP/1.1" 200 - via_upstream - "-" 0 321 146 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "687814ea-80d5-41b6-9862-8d9f8442f992" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:56100 10.132.0.59:443 10.132.0.20:36220 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T03:45:02.007Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 107 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a59ecde4-5453-4046-85c3-a3142368ee44" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.59:443 10.132.0.20:36224 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T03:45:16.661Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 88 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "9872a43c-a4b3-40e6-a4e9-51dc5ae3aef5" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.59:443 10.132.0.20:46564 - v1-completions-path [2026-10-30T03:45:17.075Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 92 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "e77501fd-3da9-4447-bbd6-de2a262eee9c" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:40432 10.132.0.59:443 10.132.0.20:46576 - v1-completions-path 2026-10-30T03:45:18.723703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T03:45:18.723898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:45:18.724019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:45:18.724076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:45:18.724114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T03:45:18.607Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 116 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "de2ad290-04fc-48f4-b340-be2e41fac333" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:56090 10.132.0.59:443 10.132.0.20:50538 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T03:49:40.447Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 328 83 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "d40d0cf5-7e6d-4f8e-9304-200b7bd79f1d" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:40432 10.132.0.59:443 10.132.0.20:53314 - v1-chat-completions-path 2026-10-30T03:52:21.826898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:52:21.826952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:52:21.826965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T03:52:21.826970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:52:21.827132Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-10-30T03:52:21.827182Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T03:52:21.827190Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T03:52:21.827192Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T03:52:21.827196Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T03:52:20.839Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 338 737 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "948fcb76-7f11-4830-9b4a-1ff6938d5b44" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:40432 10.132.0.59:443 10.132.0.20:51578 - v1-chat-completions-path [2026-10-30T03:52:21.757Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 69 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "2af2a86d-314b-4444-99b2-349bdc6554cd" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:40432 10.132.0.59:443 10.132.0.20:51584 - v1-completions-path [2026-10-30T03:52:25.536Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 32 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "b27c57f3-c382-488c-94c7-c2d39a4e8c9f" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.59:443 10.132.0.20:51594 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T03:55:07.742Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 324 81 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "e708bb02-caa9-4311-93d7-5065d3c89527" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:50042 10.132.0.59:443 10.132.0.20:40652 - v1-chat-completions-path [2026-10-30T03:59:36.918Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 13 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7bdf5011-f799-439c-8b30-f47dc3576354" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.59:443 10.132.0.20:33798 - - 2026-10-30T04:02:37.973359Z info ads ADS: new connection for node:3 2026-10-30T04:02:37.987720Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T04:02:37.987777Z info cache read certificate from file resource=file-root:system 2026-10-30T04:05:51.484609Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T04:07:26.210980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:07:45.458482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:07:47.836533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T04:07:47.836648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:07:47.836682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:07:47.836710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:07:47.836720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T04:07:47.727Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 109 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "17fe8473-dd0e-4634-b469-fc620e82a7ca" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:42162 10.132.0.59:443 10.132.0.20:59802 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:07:48.559Z] "POST /llm/e2e-dft-d9f9cd/anything/e2e-dft-d9f9cd-837b1e HTTP/1.1" 401 - - "-" 109 88 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3270c6fd-8e0c-42e3-a984-a81f6a336ebf" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-d9f9cd.llm.svc.cluster.local - 10.132.0.59:443 10.132.0.20:59818 - llm.external-model-e2e-dft-d9f9cd-b33c99c7ac48.2 2026-10-30T04:08:00.463880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:08:11.296897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:08:16.095277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:08:17.984090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:08:21.657669Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:08:21.858634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:08:56.754184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:12:13.102761Z info ads ADS: new connection for node:4 2026-10-30T04:12:13.103031Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:12:13.103065Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:14:04.887524Z info ads ADS: "" 4 terminated 2026-10-30T04:14:28.724765Z info ads ADS: "" 3 terminated 2026-10-30T04:19:25.989523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:21:20.219776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:22:53.653798Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-30T04:24:02.442010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:25:41.075236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:33:31.902058Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T04:34:38.852058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:35:03.544758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:35:35.840156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:35:41.337Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "f57cd941-06c7-9240-9ca2-d653bce31276" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:35648 10.132.0.59:443 10.132.0.20:34564 - v1-chat-completions-path 2026-10-30T04:35:53.287274Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:35:55.778877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:36:06.699741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:36:24.753199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:36:26.975112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:36:29.652402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:36:29.652439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:36:29.652454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:36:29.652460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T04:36:29.563Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 314 89 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a986a31b-8013-4949-a714-2b6a85ae1fc5" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:45744 10.132.0.59:443 10.132.0.20:52066 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:36:41.752491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:36:52.525359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:36:54.505524Z info ads ADS: new connection for node:5 2026-10-30T04:36:54.505639Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:36:54.505661Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:36:56.198735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:37:36.584120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:37:45.517Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 333 87 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "4de3a414-6ec4-4968-beec-023dc777e51c" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.1.10:8000" outbound|54321||e2e-prio-pool-89562748-inference-pool-ip-eef2bbad.llm.svc.cluster.local 10.132.0.59:56550 10.132.0.59:443 10.132.0.20:38408 - v1-model-routing 2026-10-30T04:38:00.698012Z info ads ADS: "" 5 terminated with stream closed 2026-10-30T04:38:00.763707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:38:02.204901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:38:04.366318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:38:09.474640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:39:45.922522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:40:02.985800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:40:23.812905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:40:35.829061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:40:39.489686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:40:49.701631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:40:54.100465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:40:59.722757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:40:59.722797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:40:59.722815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:40:59.722821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T04:40:59.667Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 55 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "23d6c0da-9a44-41ec-9636-d2dd98573c4f" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:57720 10.132.0.59:443 10.132.0.20:57102 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:41:12.285279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:41:56.213067Z info ads ADS: new connection for node:6 2026-10-30T04:41:56.222478Z info cache read certificate from file resource=file-root:system 2026-10-30T04:41:57.390773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:41:58.893273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:42:06.025755Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"1112","StreamId":"10974840739845956453"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-10-30T04:42:05.960Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 65 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ee530bdb-9fdf-4656-81f2-98f3b62dcc88" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.0.59:443 10.132.0.20:42042 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-30T04:42:27.351911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:42:27.351975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:42:27.351990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:42:27.351997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:42:27.352217Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T04:42:27.238Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1727 113 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "29f0cc5e-db8e-4763-90bf-1da3ac68b37f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.59:39604 10.132.0.59:443 10.132.0.20:38434 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:43:29.608487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:43:29.716209Z info ads ADS: "" 6 terminated with stream closed 2026-10-30T04:43:30.474882Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T04:43:30.474906Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T04:43:30.474909Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T04:43:30.474914Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T04:43:30.438Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 36 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "73d94ecc-adca-4b07-bf9c-843aa52da60a" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.59:443 10.132.0.20:54216 - v1-completions-path 2026-10-30T04:43:31.019711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:43:36.637777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:43:42.585Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 76 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "2a4dc5db-6fee-4f02-b087-78428135041d" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45762 10.132.0.59:443 10.132.0.20:49216 - v1-completions-path [2026-10-30T04:43:42.783Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 57 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7dae85ad-6ca1-4229-8b72-3f17c9020f01" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45776 10.132.0.59:443 10.132.0.20:49224 - v1-completions-path 2026-10-30T04:43:55.517996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:44:00.115905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:44:15.453452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:44:17.772849Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:44:20.678239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:44:30.910017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:44:36.270Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "353f906c-e4bc-40e9-885d-bea2364135ac" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45776 10.132.0.59:443 10.132.0.20:59444 - v1-completions-path [2026-10-30T04:44:37.975Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "85456d4a-3b28-4581-a3aa-62a814ddaa7c" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45776 10.132.0.59:443 10.132.0.20:54334 - v1-completions-path [2026-10-30T04:44:38.206Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "d765d8b6-af03-42dc-8607-7130e038677e" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45776 10.132.0.59:443 10.132.0.20:54336 - v1-completions-path 2026-10-30T04:44:54.403408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:45:04.680326Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:45:09.141581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:45:13.272Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "9cc21d7f-9ac1-499e-afa3-000e461e23e5" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45776 10.132.0.59:443 10.132.0.20:42416 - v1-completions-path [2026-10-30T04:45:14.310Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ca8b8d0a-0eaa-4195-bbf5-1338c0412226" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45762 10.132.0.59:443 10.132.0.20:42428 - v1-completions-path 2026-10-30T04:45:26.343275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:45:28.716373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:45:47.819204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:45:52.197156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:46:07.686625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:46:10.012069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:46:27.668753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:46:38.326434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:46:41.192682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:46:47.672Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 68 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "75f15371-8a25-4d3d-a23a-7dbaa8daebb9" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:50042 10.132.0.59:443 10.132.0.20:42170 - v1-completions-path 2026-10-30T04:47:00.364780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:47:03.294392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:47:08.592Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 68 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "813dd487-973a-4814-8cdf-839d04d1677c" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:50042 10.132.0.59:443 10.132.0.20:47874 - v1-completions-path 2026-10-30T04:47:15.583398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:47:21.149Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 65 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "21b834d1-c7fd-4d02-96e1-360270e1a26d" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45776 10.132.0.59:443 10.132.0.20:55948 - v1-completions-path 2026-10-30T04:47:33.381968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:47:43.690528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:48:03.059596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:48:06.348887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:49:48.049906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:49:51.446354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:51:21.516230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:51:35.967613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:51:38.318231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:51:56.899205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:52:08.469085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:52:12.213749Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:52:27.387917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:52:37.973022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:52:40.529830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:52:47.583Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "4d63eab7-1cf5-4af0-9a7d-4a445dd8e445" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45762 10.132.0.59:443 10.132.0.20:44546 - v1-completions-path [2026-10-30T04:52:48.193Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "aa0267a7-201e-4859-a31b-36e7dacdd368" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45776 10.132.0.59:443 10.132.0.20:44548 - v1-completions-path 2026-10-30T04:53:00.718793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:53:05.266106Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:53:08.209563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:53:14.450075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:53:14.450114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:53:14.450131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:53:14.450137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T04:53:14.368Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 311 81 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "069fe44e-0a5a-4f23-92d2-b750856afdc7" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.1.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.59:50398 10.132.0.59:443 10.132.0.20:40064 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:53:31.074002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:53:41.470137Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:53:45.950072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:53:48.994620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:53:53.993832Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:53:59.035Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "9067c774-3102-4a3d-9f2f-a4cbf456de2e" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45776 10.132.0.59:443 10.132.0.20:38730 - v1-completions-path [2026-10-30T04:53:59.779Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 65 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3a770c55-0a06-4d83-a7d4-b178268e448c" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.59:45762 10.132.0.59:443 10.132.0.20:38744 - v1-completions-path 2026-10-30T04:54:12.280257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:54:22.480186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:54:24.808988Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:54:34.253224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:54:39.051136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:54:55.521966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:55:15.335988Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:55:26.566278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:55:46.175470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:55:56.646202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:56:06.836674Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:56:18.153391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:56:28.441688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:56:38.782100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:56:49.115349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8