2026-11-04T01:53:40.559911Z info FLAG: --concurrency="0" 2026-11-04T01:53:40.559932Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:53:40.559938Z info FLAG: --help="false" 2026-11-04T01:53:40.559940Z info FLAG: --log_as_json="false" 2026-11-04T01:53:40.559942Z info FLAG: --log_caller="" 2026-11-04T01:53:40.559944Z info FLAG: --log_output_level="default:info" 2026-11-04T01:53:40.559946Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:53:40.559951Z info FLAG: --log_target="[stdout]" 2026-11-04T01:53:40.559953Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:53:40.559955Z info FLAG: --outlierLogPath="" 2026-11-04T01:53:40.559957Z info FLAG: --profiling="true" 2026-11-04T01:53:40.559960Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:53:40.559962Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:53:40.559964Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:53:40.559966Z info FLAG: --stsPort="0" 2026-11-04T01:53:40.559968Z info FLAG: --templateFile="" 2026-11-04T01:53:40.559970Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:53:40.559973Z info FLAG: --vklog="0" 2026-11-04T01:53:40.559975Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:53:40.560118Z info Proxy role ips=[10.132.0.29] type=router id=maas-default-gateway-openshift-default-58847f9fc5-tb6l5.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:53:40.560170Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:53:40.561279Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:53:40.561482Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:53:40.561495Z info JWT policy is third-party-jwt 2026-11-04T01:53:40.561499Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:53:40.563450Z info Starting default Istio SDS Server 2026-11-04T01:53:40.563473Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:53:40.563498Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:53:40.564036Z info Opening status port 15020 2026-11-04T01:53:40.565438Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:53:40.565924Z info sds Starting SDS grpc server 2026-11-04T01:53:40.565987Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:53:40.567004Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:53:40.567877Z info Starting proxy agent 2026-11-04T01:53:40.567907Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:53:40.640506Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:53:40.739525Z info ads ADS: new connection for node:1 2026-11-04T01:53:40.739957Z info ads ADS: new connection for node:2 2026-11-04T01:53:40.740608Z info cache generated new workload certificate resourceName=default latency=174.476245ms ttl=23h59m59.259394577s 2026-11-04T01:53:40.740634Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:53:40.740663Z info cache returned workload trust anchor from cache ttl=23h59m59.259338275s 2026-11-04T01:53:40.740682Z info cache returned workload certificate from cache ttl=23h59m59.259318955s 2026-11-04T01:53:40.740932Z info cache returned workload trust anchor from cache ttl=23h59m59.259070491s 2026-11-04T01:53:40.742391Z info cache returned workload trust anchor from cache ttl=23h59m59.257610098s 2026-11-04T01:53:40.783719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:47.091279Z info Readiness succeeded in 6.534782664s 2026-11-04T01:53:47.091628Z info Envoy proxy is ready 2026-11-04T01:54:20.988303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:22.191871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:54.240293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:57.791619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:59.673246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:02.884663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:06.767981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:11.133519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:35.720830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:55:35.720863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:55:35.720874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:55:35.720879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:55:35.608Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 112 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "49b62ea9-a160-45fe-b81f-3d59c78b593d" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:39890 10.132.0.29:443 10.132.0.15:40370 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:55:35.862194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:35.862241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:35.862261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:35.862268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:55:35.776Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 85 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "9c1ab248-ad4b-448f-91cc-d6cb1dfcb834" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:39892 10.132.0.29:443 10.132.0.15:40386 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:55:35.915Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 502 94 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "80115914-ea96-4a9b-ad58-cd400ad695cb" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:49002 10.132.0.29:443 10.132.0.15:40390 - v1-model-routing [2026-11-04T01:55:36.056Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 427 76 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "d9177e61-e9a1-4978-880e-a969c2fb1ce2" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:49012 10.132.0.29:443 10.132.0.15:40392 - v1-model-routing [2026-11-04T01:55:36.161Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 359 67 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "726c495b-be6d-4c33-b3af-82b000ba1f71" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:49002 10.132.0.29:443 10.132.0.15:40408 - v1-model-routing [2026-11-04T01:55:36.255Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 64 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "cbdfbc93-7baf-4ada-9721-97234df39569" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.29:443 10.132.0.15:40410 - v1-model-routing [2026-11-04T01:55:36.344Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 68 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "e3d6dc56-bcd4-404f-864a-6a5d78c0d401" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.29:443 10.132.0.15:40418 - v1-model-routing 2026-11-04T01:55:36.897202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-04T01:55:37.132856Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T01:55:37.132880Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T01:55:37.132883Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T01:55:37.132887Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-04T01:55:36.571Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 82 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "54a13b3e-4bff-4880-a162-1a57fa743bcf" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.29:443 10.132.0.15:40430 - v1-model-routing [2026-11-04T01:55:36.681Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 66 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "594b93a3-3dea-4ea9-be7a-0bd72b002037" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.29:443 10.132.0.15:40432 - v1-model-routing [2026-11-04T01:55:36.892Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 82 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "7903e7c0-088d-4620-83a7-7b6bc88cfe85" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.29:443 10.132.0.15:40444 - v1-model-routing [2026-11-04T01:55:37.114Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 18 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "8dd5d606-8498-411f-9c3b-42d894bc790d" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.29:443 10.132.0.15:40456 - v1-model-routing 2026-11-04T01:55:37.668066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:37.668099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:37.668111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:37.668115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:55:37.788771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:37.788810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:37.788828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:37.788835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:55:37.656Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 11 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "17d7a251-f52e-4e79-8ab6-cc6169f1e796" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:39892 10.132.0.29:443 10.132.0.15:40462 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-04T01:55:37.692Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 96 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "83a0d9dd-24f1-4b19-856c-70d4c34ff074" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:39892 10.132.0.29:443 10.132.0.15:40466 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:03.858Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 43 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "2f6298da-2a44-4a39-a11b-30fb4fb4ecf1" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.29:443 10.132.0.15:54584 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:58:04.808872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:04.808907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:04.808919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:58:04.808924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T01:58:04.665Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 143 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "13ce52ef-a674-40ac-a418-84cf212cf2ff" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:48870 10.132.0.29:443 10.132.0.15:54596 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:58:05.715345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-04T01:58:05.719775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:05.719805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:05.719818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:05.719823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:58:06.046017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.046063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.046082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.046090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:58:06.332789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.332832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.332851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:58:06.332857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:58:05.641Z] "DELETE /v1/api-keys/824dcf84-29eb-49fc-b531-235aa6091b48 HTTP/1.1" 200 - via_upstream - "-" 0 321 78 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "8a172b14-0c59-4ae8-b37f-c5ef0de2fede" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:48870 10.132.0.29:443 10.132.0.15:54602 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:05.919Z] "DELETE /v1/api-keys/103b5955-60c7-4dac-b005-b9c7726e1be7 HTTP/1.1" 200 - via_upstream - "-" 0 321 126 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "3cfebd38-269f-480f-8b4e-d5767a9c6699" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:48886 10.132.0.29:443 10.132.0.15:54618 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:06.261Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 71 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "f0d5f280-c2c7-4fae-ae2c-ffb9a0c0ed25" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:48886 10.132.0.29:443 10.132.0.15:54620 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:58:06.568333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.568366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.568379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:58:06.568384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.782978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:06.783017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:06.783039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:06.783046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:58:07.242531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:07.242572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:07.242623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:07.242630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:58:06.493Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 75 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "e406ee2b-b286-4dc5-96d2-ccaf5a035a28" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:48886 10.132.0.29:443 10.132.0.15:54628 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:06.716Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 66 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "ffcdca7d-4e91-4644-aa31-1c826c2c4cb8" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:48870 10.132.0.29:443 10.132.0.15:54640 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:07.173Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 69 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "f651c968-a5de-49b5-b81d-2a5fbdae3205" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:48870 10.132.0.29:443 10.132.0.15:54654 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:07.592Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 69 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "c55ead8f-61bd-4ae7-841e-a1eee295b05c" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:49002 10.132.0.29:443 10.132.0.15:54674 - v1-completions-path 2026-11-04T01:58:08.920851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:08.920883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:08.920896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:58:08.920901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:58:08.840Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 80 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "190a3540-d095-4697-b6c1-6e02781d0673" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:48886 10.132.0.29:443 10.132.0.15:54688 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:58:10.021900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:10.021939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:10.021956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:10.021960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:58:10.055344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:10.055376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:10.055388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:58:10.055393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:58:09.950Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 71 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "3a871ca5-c150-4f9b-a1bb-0ce07f32b989" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:48870 10.132.0.29:443 10.132.0.15:54692 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:10.045Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 9 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "12aafc15-5258-48dd-9bee-9a025523539c" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.29:48886 10.132.0.29:443 10.132.0.15:54694 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-04T01:58:10.078Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 19 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "a46db597-e102-4e78-9063-bc9081804069" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.29:443 10.132.0.15:54704 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:10.304Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 384 74 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "8b511db0-ffdc-4563-9fe8-341256901f0f" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:49012 10.132.0.29:443 10.132.0.15:54712 - v1-chat-completions-path [2026-11-04T01:58:10.400Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 4603 85 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "4ccf7e92-7d5a-4d72-8893-421a0a565900" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:49012 10.132.0.29:443 10.132.0.15:54718 - v1-chat-completions-path 2026-11-04T01:58:10.583438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:10.583479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:10.583497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:58:10.583503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:10.583718Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-04T01:58:10.583783Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:58:10.583795Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:58:10.583798Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:58:10.583803Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-04T01:58:10.507Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 76 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "17e3b21d-4058-45d8-b097-c28c08675aec" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:49012 10.132.0.29:443 10.132.0.15:54722 - v1-completions-path 2026-11-04T01:59:12.638494Z info ads ADS: new connection for node:3 2026-11-04T01:59:12.643156Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T01:59:12.643206Z info cache read certificate from file resource=file-root:system 2026-11-04T01:59:13.416257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:31.658216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:00:21.974903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:01:06.157932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:01:27.604094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:01:32.521662Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:02:26.100160Z info ads ADS: "" 3 terminated 2026-11-04T02:02:40.588217Z info ads ADS: new connection for node:4 2026-11-04T02:02:40.592328Z info cache read certificate from file resource=file-root:system 2026-11-04T02:02:41.999029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:02:50.767721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:03:15.522657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:03:15.543455Z info ads ADS: "" 4 terminated 2026-11-04T02:03:15.814325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:03:26.964713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8