2026-10-31T03:05:17.393513Z info FLAG: --concurrency="0" 2026-10-31T03:05:17.393534Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T03:05:17.393539Z info FLAG: --help="false" 2026-10-31T03:05:17.393541Z info FLAG: --log_as_json="false" 2026-10-31T03:05:17.393543Z info FLAG: --log_caller="" 2026-10-31T03:05:17.393545Z info FLAG: --log_output_level="default:info" 2026-10-31T03:05:17.393547Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T03:05:17.393552Z info FLAG: --log_target="[stdout]" 2026-10-31T03:05:17.393555Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T03:05:17.393557Z info FLAG: --outlierLogPath="" 2026-10-31T03:05:17.393559Z info FLAG: --profiling="true" 2026-10-31T03:05:17.393561Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T03:05:17.393563Z info FLAG: --proxyLogLevel="warning" 2026-10-31T03:05:17.393565Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T03:05:17.393567Z info FLAG: --stsPort="0" 2026-10-31T03:05:17.393569Z info FLAG: --templateFile="" 2026-10-31T03:05:17.393571Z info FLAG: --tokenManagerPlugin="" 2026-10-31T03:05:17.393574Z info FLAG: --vklog="0" 2026-10-31T03:05:17.393576Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T03:05:17.393729Z info Proxy role ips=[10.134.0.37] type=router id=maas-default-gateway-openshift-default-6db586dd6c-5bjzn.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T03:05:17.393777Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T03:05:17.395093Z info cpu limit detected as 2, setting concurrency 2026-10-31T03:05:17.395357Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T03:05:17.395373Z info JWT policy is third-party-jwt 2026-10-31T03:05:17.395376Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T03:05:17.397443Z info Starting default Istio SDS Server 2026-10-31T03:05:17.397466Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T03:05:17.397483Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T03:05:17.397932Z info Opening status port 15020 2026-10-31T03:05:17.398577Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T03:05:17.399818Z info sds Starting SDS grpc server 2026-10-31T03:05:17.399842Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T03:05:17.400126Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T03:05:17.401009Z info Starting proxy agent 2026-10-31T03:05:17.401047Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T03:05:17.471017Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T03:05:17.519397Z info cache generated new workload certificate resourceName=default latency=119.37768ms ttl=23h59m59.480610838s 2026-10-31T03:05:17.519472Z info cache Root cert has changed, start rotating root cert 2026-10-31T03:05:17.519525Z info cache returned workload trust anchor from cache ttl=23h59m59.480476389s 2026-10-31T03:05:17.589096Z info ads ADS: new connection for node:1 2026-10-31T03:05:17.589171Z info cache returned workload certificate from cache ttl=23h59m59.410831648s 2026-10-31T03:05:17.590602Z info ads ADS: new connection for node:2 2026-10-31T03:05:17.590694Z info cache returned workload trust anchor from cache ttl=23h59m59.40930774s 2026-10-31T03:05:17.671430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:05:25.630493Z info Readiness succeeded in 8.239587865s 2026-10-31T03:05:25.630935Z info Envoy proxy is ready [2026-10-31T03:05:49.686Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 63 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "013380fc-fe4c-4984-bf5e-2f73e2c97a8e" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.21:44906 - v1-model-routing 2026-10-31T03:05:50.544502Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T03:05:50.544525Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T03:05:50.544528Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T03:05:50.544532Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T03:05:49.937Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 57 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "cfcc1d33-bffd-445d-a85e-1119a6d3d9b5" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.21:44914 - v1-model-routing [2026-10-31T03:05:50.057Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 52 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "3c2df194-06ad-4c74-bf88-b4ce572f9128" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.21:44920 - v1-model-routing [2026-10-31T03:05:50.171Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "99d29ef3-ddd3-480d-a6cc-307842f28a05" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.21:44924 - v1-model-routing [2026-10-31T03:05:50.302Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 49 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "f21bdac9-f121-4f55-a43a-a2f29a093ecf" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.21:44926 - v1-model-routing [2026-10-31T03:05:50.526Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 17 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "5ff786b3-20b1-4285-903d-3f0d22559039" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.21:44942 - v1-model-routing 2026-10-31T03:05:50.880992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:05:50.881030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:05:50.881046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:05:50.881051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T03:05:50.820Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 60 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "ee78e324-1797-4056-a36c-f0f5b3259bb5" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:56254 10.134.0.37:443 10.132.0.21:44958 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:08:21.364462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T03:08:21.364499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T03:08:21.364514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T03:08:21.364519Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T03:08:21.289Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 74 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "72acd14d-0b2c-4218-9f1d-7b136700bdf3" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:58924 10.134.0.37:443 10.132.0.21:33818 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:08:22.640533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:08:22.640571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:08:22.640586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:08:22.640591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T03:08:22.573Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 67 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "605394a1-fc5d-4653-92f3-f05c6d23ed90" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:58936 10.134.0.37:443 10.132.0.21:45918 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:08:22.701037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T03:08:22.701085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T03:08:22.701107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T03:08:22.701113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T03:08:22.638Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 62 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "04f1b072-4f00-4fbf-9d1b-60259402ef59" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:58924 10.134.0.37:443 10.132.0.21:45930 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:08:47.426834Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:09:05.087553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:11:26.135762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:11:26.135811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:11:26.135835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T03:11:26.135841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T03:11:26.059Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 76 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "22437a0a-8e8a-4caa-9667-b86c48d91f27" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:36614 10.134.0.37:443 10.132.0.21:41446 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:11:32.240233Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: gRPC status code is not OK thread=24 [2026-10-31T03:11:30.231Z] "POST /maas-api/v1/tokens HTTP/1.1" 500 - - "-" 20 23 2013 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "3527247e-36b0-4dd8-bf84-7d088c59a2ee" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.37:443 10.132.0.21:41466 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:11:49.634784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:11:49.634838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:11:49.634866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:11:49.634873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T03:11:48.700Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 934 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b0544eb6-7769-454e-96cb-bfed64bc916b" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:36614 10.134.0.37:443 10.132.0.21:40238 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:12:50.281213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:13:24.970974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:14:18.036407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:16:26.796951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:17:08.211505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:18:21.844297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:20:12.202052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:21:33.699614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:26:14.774119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:26:14.774159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:26:14.774175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T03:26:14.774180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T03:26:14.686Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 87 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "6f209341-b0d5-4108-9f15-19b0203f8158" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:42302 10.134.0.37:443 10.132.0.21:38158 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:26:17.084672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:26:41.510679Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:27:28.697057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:27:31.367836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:27:31.367871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:27:31.367886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T03:27:31.367891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T03:27:31.301Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 66 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "0e95f7bd-0d33-442e-97d0-38c0d29e8338" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:37024 10.134.0.37:443 10.132.0.21:41622 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:27:44.129773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:27:45.774285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T03:27:51.162Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b42bb59e-a017-4e15-9066-aafbd61538b2" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.21:53656 - v1-completions-path [2026-10-31T03:27:51.270Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 51 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "82ce79ba-5bc3-4672-9bc7-5230bc920c1d" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.21:53668 - v1-completions-path 2026-10-31T03:28:02.925224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:28:04.629449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:28:07.455838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:28:15.884472Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T03:28:23.843Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 74 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "549161a3-1811-40ec-bb2c-6760f7d425c7" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:49932 10.134.0.37:443 10.132.0.21:33958 - v1-completions-path 2026-10-31T03:28:40.329662Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:28:50.591575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:28:52.711957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:28:58.642405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T03:28:58.580Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "0346d3d1-5114-4f3c-949d-20c80832476d" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:60708 10.134.0.37:443 10.132.0.21:59310 - v1-completions-path [2026-10-31T03:28:59.052Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "9214880f-60f9-4a0c-8cb2-198a4baa2252" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:60708 10.134.0.37:443 10.132.0.21:59316 - v1-completions-path [2026-10-31T03:28:59.295Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "4b126f03-730e-44e5-87e2-4642191c7041" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:49932 10.134.0.37:443 10.132.0.21:59320 - v1-completions-path 2026-10-31T03:29:11.542507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:29:13.192695Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:29:18.303963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:29:18.304023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:29:18.304045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:29:18.304052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T03:29:18.200Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 104 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "05ed54f6-6731-4a8a-a464-ad5277b46296" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:39276 10.134.0.37:443 10.132.0.21:34080 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:29:29.978394Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:29:32.141401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:29:48.779421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:29:50.554395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:30:06.644161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:30:17.464752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:30:20.125611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:30:35.696121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:30:37.299359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:30:46.370765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:30:52.922282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:30:52.922325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:30:52.922343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T03:30:52.922348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T03:30:52.859Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 62 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "efa3f033-7365-448e-a6f8-0807195547ce" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:60356 10.134.0.37:443 10.132.0.21:35162 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:31:04.812910Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:31:15.048759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:31:31.492019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:31:33.866942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T03:33:11.774Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 47 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "3c5472c2-545b-4564-a7d0-f78a8502d842" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.21:32842 - v1-completions-path 2026-10-31T03:33:12.816818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:33:15.149479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:34:42.538498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:34:57.489681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:34:59.137596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:35:16.613729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:35:25.901428Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T03:36:41.331047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:36:41.331086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:36:41.331100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:36:41.331105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T03:36:41.260Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 70 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a3eb9a36-1a98-444e-924b-6a208589df53" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:34466 10.134.0.37:443 10.132.0.21:51456 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T03:36:45.302984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:37:00.958367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:37:17.919653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:37:29.767814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:37:33.276640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:37:41.800464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:37:43.769912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:38:00.148717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:40:50.998378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:40:56.322613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:41:11.492271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:41:13.203859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:41:15.902187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T03:41:15.920277Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T03:41:15.838Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 81 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "f8db2916-7246-4fee-b005-27cd3677c09b" "maas.apps.45d24a4eb0434b03cd2c.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:46750 10.134.0.37:443 10.132.0.21:37602 - v1-catch-all-path 2026-10-31T03:41:27.382879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:41:38.274349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8