2026-10-29T22:27:12.897910Z info FLAG: --concurrency="0" 2026-10-29T22:27:12.897925Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-29T22:27:12.897929Z info FLAG: --help="false" 2026-10-29T22:27:12.897931Z info FLAG: --log_as_json="false" 2026-10-29T22:27:12.897933Z info FLAG: --log_caller="" 2026-10-29T22:27:12.897935Z info FLAG: --log_output_level="default:info" 2026-10-29T22:27:12.897937Z info FLAG: --log_stacktrace_level="default:none" 2026-10-29T22:27:12.897941Z info FLAG: --log_target="[stdout]" 2026-10-29T22:27:12.897944Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-29T22:27:12.897945Z info FLAG: --outlierLogPath="" 2026-10-29T22:27:12.897947Z info FLAG: --profiling="true" 2026-10-29T22:27:12.897949Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-29T22:27:12.897951Z info FLAG: --proxyLogLevel="warning" 2026-10-29T22:27:12.897953Z info FLAG: --serviceCluster="istio-proxy" 2026-10-29T22:27:12.897955Z info FLAG: --stsPort="0" 2026-10-29T22:27:12.897957Z info FLAG: --templateFile="" 2026-10-29T22:27:12.897959Z info FLAG: --tokenManagerPlugin="" 2026-10-29T22:27:12.897961Z info FLAG: --vklog="0" 2026-10-29T22:27:12.897964Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-29T22:27:12.898095Z info Proxy role ips=[10.132.0.46] type=router id=maas-default-gateway-openshift-default-6f77ddbcb7-lzjlp.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-29T22:27:12.898140Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-29T22:27:12.899428Z info cpu limit detected as 2, setting concurrency 2026-10-29T22:27:12.900053Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-29T22:27:12.900069Z info JWT policy is third-party-jwt 2026-10-29T22:27:12.900073Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-29T22:27:12.901339Z info Starting default Istio SDS Server 2026-10-29T22:27:12.901365Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-29T22:27:12.901383Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-29T22:27:12.901356Z info Opening status port 15020 2026-10-29T22:27:12.902385Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-29T22:27:12.904762Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-29T22:27:12.906182Z info Starting proxy agent 2026-10-29T22:27:12.906230Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-29T22:27:12.906744Z info sds Starting SDS grpc server 2026-10-29T22:27:12.906762Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-29T22:27:12.971296Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-29T22:27:13.102026Z info cache generated new workload certificate resourceName=default latency=198.984418ms ttl=23h59m59.897979033s 2026-10-29T22:27:13.102073Z info cache Root cert has changed, start rotating root cert 2026-10-29T22:27:13.102110Z info cache returned workload trust anchor from cache ttl=23h59m59.897891341s 2026-10-29T22:27:13.123247Z info ads ADS: new connection for node:1 2026-10-29T22:27:13.123359Z info cache returned workload certificate from cache ttl=23h59m59.876644429s 2026-10-29T22:27:13.124176Z info ads ADS: new connection for node:2 2026-10-29T22:27:13.124442Z info cache returned workload trust anchor from cache ttl=23h59m59.875573696s 2026-10-29T22:27:13.208780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:27:21.171607Z info Readiness succeeded in 8.276157778s 2026-10-29T22:27:21.171932Z info Envoy proxy is ready [2026-10-29T22:27:31.211Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 334 116 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "b950b7fb-a425-4c18-8c01-4563ede3572d" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59316 10.132.0.46:443 10.132.0.9:41640 - v1-model-routing [2026-10-29T22:27:31.372Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 481 65 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "ffc4addd-0286-472b-8c03-6b2b8202c16d" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59318 10.132.0.46:443 10.132.0.9:41650 - v1-model-routing [2026-10-29T22:27:31.464Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 488 65 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "86238722-971b-48a2-8481-fde857416a02" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59318 10.132.0.46:443 10.132.0.9:41654 - v1-model-routing [2026-10-29T22:27:31.558Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 65 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "5cfc6ac2-b0cf-4954-b2df-d7729e0421d9" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.46:443 10.132.0.9:41660 - v1-model-routing [2026-10-29T22:27:31.647Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 55 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "fd6c8490-c820-44bb-9437-7cf7e642c915" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.46:443 10.132.0.9:41668 - v1-model-routing 2026-10-29T22:29:49.161075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:29:49.161111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:29:49.161125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T22:29:49.161130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-29T22:29:49.086Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 74 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "bde2ba1e-3784-4057-bcd4-5f4774282ff9" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.46:41238 10.132.0.46:443 10.132.0.9:59600 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:29:49.603348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:29:49.603382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:29:49.603397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:29:49.603401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:29:49.968889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:29:49.968922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:29:49.968935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:29:49.968940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:29:50.146107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:29:50.146142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:29:50.146175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:29:50.146180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-29T22:29:49.495Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 107 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "d882c683-c638-4035-a375-1a38cf489bbd" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.46:41248 10.132.0.46:443 10.132.0.9:59616 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:29:49.892Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 76 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "8097da3c-9eda-4f7c-8caf-ce2611ab8963" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.46:41248 10.132.0.46:443 10.132.0.9:59624 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:29:50.078Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 68 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "75be4c23-50cf-412e-905e-a3362775a07e" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.46:41238 10.132.0.46:443 10.132.0.9:59626 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:29:50.509123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-29T22:29:50.509232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:29:50.509254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:29:50.509269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T22:29:50.509273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-29T22:29:50.444Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 65 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "942500a6-014c-445b-ba2a-e08400c0d85d" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.46:41238 10.132.0.46:443 10.132.0.9:39272 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:29:58.664410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-29T22:30:02.975Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 76 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "ccabdbcd-c6e2-4a0b-83e9-fb27c24565f0" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59318 10.132.0.46:443 10.132.0.9:48366 - v1-completions-path 2026-10-29T22:30:14.185184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-29T22:33:46.319Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 356 167 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "5d403e6f-6353-4b83-80f3-cbd8483d3eca" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59316 10.132.0.46:443 10.132.0.9:58952 - v1-chat-completions-path 2026-10-29T22:34:34.136897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:35:10.528455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:36:45.528196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:40:54.342921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:43:06.370797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:45:51.227170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:46:41.354895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:58:53.886501Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-29T23:07:29.642006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:07:29.642041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:07:29.642055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:07:29.642060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-29T23:07:29.554Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 87 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "04c821d9-5fad-4ef0-b4f2-289e410a6a1f" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.46:56420 10.132.0.46:443 10.132.0.9:59672 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:07:33.608288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:07:55.999460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:08:07.343540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:08:07.343575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:08:07.343587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T23:08:07.343591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-29T23:08:07.243Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 99 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "436f19d5-46b1-4fdb-8ce8-1640b6465e99" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.46:46952 10.132.0.46:443 10.132.0.9:52046 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:08:41.393124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-29T23:08:45.750Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 68 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "055f4e16-05f2-41b6-b884-fe0cd6def3d7" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59404 10.132.0.46:443 10.132.0.9:48618 - v1-completions-path 2026-10-29T23:08:58.590092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:09:03.304364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:09:07.303708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-29T23:09:07.243Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "27781937-5f5d-4668-a02c-7bba4a11849f" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59404 10.132.0.46:443 10.132.0.9:41416 - v1-completions-path 2026-10-29T23:09:19.463764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:09:34.933854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:09:40.806341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-29T23:09:40.573Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "eb62cf2c-eb22-416b-98b5-fb3af60615f5" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:42212 10.132.0.46:443 10.132.0.9:51546 - v1-completions-path [2026-10-29T23:09:40.759Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 50 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "b0223da1-cda6-4242-b5f6-311ded5e3966" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:42212 10.132.0.46:443 10.132.0.9:51556 - v1-completions-path [2026-10-29T23:09:41.489Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 54 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "39472f3e-281a-4083-ae55-d8fb8ee1f5f3" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:42212 10.132.0.46:443 10.132.0.9:51568 - v1-completions-path [2026-10-29T23:09:41.906Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 56 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "557a9716-7b0e-455d-a5af-728cd79adaa5" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59404 10.132.0.46:443 10.132.0.9:51580 - v1-completions-path [2026-10-29T23:09:42.506Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "a6b4f7a7-ceb4-4e76-8d90-99863869d767" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59404 10.132.0.46:443 10.132.0.9:51596 - v1-completions-path 2026-10-29T23:09:58.415214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:10:08.785522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:10:12.918863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-29T23:10:17.409Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "fb0028ff-ef6b-4fb8-aebc-8c06b6120487" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59404 10.132.0.46:443 10.132.0.9:39530 - v1-completions-path 2026-10-29T23:10:30.226887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:10:32.393393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:10:51.789707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:10:55.941401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-29T23:11:11.216Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 61 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "a54d4c1f-13a5-4bb4-9c58-dbe50f0325ca" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:59318 10.132.0.46:443 10.132.0.9:59924 - v1-completions-path 2026-10-29T23:11:13.587561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:11:30.668198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:11:41.396097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:11:44.523475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:15:14.925107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:15:30.534766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:15:32.663676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:15:48.002869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:17:07.776413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:17:30.722556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:17:44.115227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:17:57.066610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:17:59.992813Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:17:59.992847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:17:59.992860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T23:17:59.992864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-29T23:17:57.972Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 2020 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "49ee3e97-407e-48f5-84a4-ed140185fb56" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.46:47252 10.132.0.46:443 10.132.0.9:37644 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:18:01.017710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:18:11.843435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:18:16.191724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:18:34.425935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:18:44.354352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:18:50.379745Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-29T23:18:50.304Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 75 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "94098a0a-1003-4787-9eb6-48027e048bd7" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.46:42978 10.132.0.46:443 10.132.0.9:34804 - v1-catch-all-model-routing 2026-10-29T23:18:52.635027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:19:05.644713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:19:07.869678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:19:10.496780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:19:10.496818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:19:10.496833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:19:10.496837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-29T23:19:10.401Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 95 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "3b03a4db-e356-48c4-bf2a-ef2a1eea3eb8" "maas.apps.69860102db373d47a588.prod.konflux-ocp-ci.dev" "10.134.1.9:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.46:42370 10.132.0.46:443 10.132.0.9:49832 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:19:22.554890Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:19:33.574658Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9