2026-06-07T16:41:38.153665Z info ads Push debounce stable[135] 2 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway and 1 more configs: 101.052374ms since last change, 147.015175ms since last push, full=true 2026-06-07T16:41:38.158819Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:41:38.159365Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-06-07T16:41:38.159379Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-06-07T16:41:38.159430Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-06-07T16:41:38.159454Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-06-07T16:41:38.159664Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:41:38.159668Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:41:38.159869Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:41:38.160192Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:19.1kB cached:0/0 2026-06-07T16:41:38.163155Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:44.8kB 2026-06-07T16:41:38.302102Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-06-07T16:41:39.527349Z info ads Push debounce stable[136] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.095491ms since last change, 100.095437ms since last push, full=false 2026-06-07T16:41:39.527406Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:41:40.071553Z info ads Push debounce stable[137] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.230325ms since last change, 100.230198ms since last push, full=false 2026-06-07T16:41:40.071611Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:41:44.672077Z info ads Push debounce stable[138] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.241566ms since last change, 100.2415ms since last push, full=false 2026-06-07T16:41:44.672154Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:41:47.568901Z info ads Push debounce stable[139] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.454375ms since last change, 100.454301ms since last push, full=false 2026-06-07T16:41:47.568960Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:41:56.867910Z info ads Push debounce stable[140] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.226419ms since last change, 100.226347ms since last push, full=false 2026-06-07T16:41:56.867976Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:41:59.366825Z info ads Push debounce stable[141] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.583381ms since last change, 100.583319ms since last push, full=false 2026-06-07T16:41:59.366914Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:06.465533Z info ads Push debounce stable[142] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.233044ms since last change, 100.232971ms since last push, full=false 2026-06-07T16:42:06.465615Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:24.170913Z info ads Push debounce stable[143] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.240889ms since last change, 100.240818ms since last push, full=false 2026-06-07T16:42:24.170973Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:37.421632Z info ads Push debounce stable[144] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.672984ms since last change, 100.672891ms since last push, full=false 2026-06-07T16:42:37.421699Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:40.445303Z info ads Push debounce stable[145] 6 for config ServiceEntry/kuadrant-system/authorino-authorino-authorization.kuadrant-system.svc.cluster.local and 2 more configs: 100.630201ms since last change, 123.605271ms since last push, full=false 2026-06-07T16:42:40.445359Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:40.725393Z info ads Push debounce stable[146] 3 for config ServiceEntry/kuadrant-system/authorino-authorino-oidc.kuadrant-system.svc.cluster.local and 2 more configs: 100.347399ms since last change, 105.587302ms since last push, full=false 2026-06-07T16:42:40.725449Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:41.050031Z info ads Push debounce stable[147] 7 for config ConfigMap/premium-users-namespace/kube-root-ca.crt and 3 more configs: 100.791809ms since last change, 141.486997ms since last push, full=false 2026-06-07T16:42:41.050112Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:41.232049Z info ads Push debounce stable[148] 2 for config Secret/premium-users-namespace/premium-service-account-dockercfg-7zq2g: 100.187958ms since last change, 111.969646ms since last push, full=false 2026-06-07T16:42:41.232119Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:42.155071Z info ads Push debounce stable[149] 7 for config Secret/maas-admin/builder-dockercfg-8scvs and 3 more configs: 100.790894ms since last change, 145.857211ms since last push, full=false 2026-06-07T16:42:42.155131Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:42.326600Z info ads Push debounce stable[150] 2 for config Secret/maas-admin/tester-admin-user-dockercfg-v8tqd: 100.221875ms since last change, 111.899744ms since last push, full=false 2026-06-07T16:42:42.326683Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:43.851067Z info ads Push debounce stable[151] 2 for config Secret/default/tester-regular-user-dockercfg-x5ghh: 100.561482ms since last change, 111.125967ms since last push, full=false 2026-06-07T16:42:43.851146Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:42:59.813499Z info ads Push debounce stable[152] 2 for config Secret/llm/e2e-apikey-active-sa-dockercfg-bp4xd: 100.193762ms since last change, 110.881663ms since last push, full=false 2026-06-07T16:42:59.813572Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:43:00.973215Z info ads Push debounce stable[153] 1 for config Secret/llm/e2e-apikey-active-sa-dockercfg-bp4xd: 100.238329ms since last change, 100.238257ms since last push, full=false 2026-06-07T16:43:00.973271Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:43:09.105320Z info ads Push debounce stable[154] 2 for config Secret/llm/e2e-apikey-degraded-sa-dockercfg-h7c8v: 100.243445ms since last change, 113.825994ms since last push, full=false 2026-06-07T16:43:09.105373Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:41:38Z/80 2026-06-07T16:43:10.416009Z info ads Push debounce stable[155] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.252167ms since last change, 100.252096ms since last push, full=true 2026-06-07T16:43:10.420146Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:10Z/81 2026-06-07T16:43:10.420544Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:10.420545Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:10.423561Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:13.105832Z info ads Push debounce stable[156] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.231837ms since last change, 100.231755ms since last push, full=true 2026-06-07T16:43:13.109719Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:13Z/82 2026-06-07T16:43:13.110122Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:13.110122Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:13.112995Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:20.178493Z info ads Push debounce stable[157] 1 for config Secret/llm/e2e-apikey-degraded-sa-dockercfg-h7c8v: 100.211786ms since last change, 100.211697ms since last push, full=false 2026-06-07T16:43:20.178564Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:13Z/82 2026-06-07T16:43:21.006020Z info ads Push debounce stable[158] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.964597ms since last change, 100.964549ms since last push, full=true 2026-06-07T16:43:21.009878Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:21Z/83 2026-06-07T16:43:21.010193Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:21.010227Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:21.013353Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:44.8kB 2026-06-07T16:43:23.099877Z info ads Push debounce stable[159] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.134127ms since last change, 100.134036ms since last push, full=true 2026-06-07T16:43:23.104083Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:23Z/84 2026-06-07T16:43:23.104439Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:23.104468Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:23.107488Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:44.8kB 2026-06-07T16:43:28.299330Z info ads Push debounce stable[160] 2 for config Secret/llm/e2e-apikey-failed-sa-dockercfg-mgc6h: 100.280332ms since last change, 110.220398ms since last push, full=false 2026-06-07T16:43:28.299404Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:23Z/84 2026-06-07T16:43:29.607087Z info ads Push debounce stable[161] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.10476ms since last change, 100.104681ms since last push, full=true 2026-06-07T16:43:29.611279Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:29Z/85 2026-06-07T16:43:29.611680Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:29.611682Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:29.614851Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:31.207865Z info ads Push debounce stable[162] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.220699ms since last change, 100.220638ms since last push, full=true 2026-06-07T16:43:31.211615Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:31Z/86 2026-06-07T16:43:31.211974Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:31.211975Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:31.214986Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:32.710148Z info ads Push debounce stable[163] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.230274ms since last change, 100.230199ms since last push, full=true 2026-06-07T16:43:32.713933Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:32Z/87 2026-06-07T16:43:32.714273Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:32.714272Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:32.717509Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:33.711687Z info ads Push debounce stable[164] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.23617ms since last change, 100.236098ms since last push, full=true 2026-06-07T16:43:33.715515Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:33Z/88 2026-06-07T16:43:33.715869Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:33.715906Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:33.718460Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:34.609435Z info ads Push debounce stable[165] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.230689ms since last change, 100.230616ms since last push, full=true 2026-06-07T16:43:34.613443Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:34Z/89 2026-06-07T16:43:34.613814Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:34.613854Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:34.616577Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:35.415618Z info ads Push debounce stable[166] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.102186ms since last change, 100.102102ms since last push, full=true 2026-06-07T16:43:35.419882Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:35Z/90 2026-06-07T16:43:35.420253Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:35.420257Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:35.423635Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:39.489932Z info ads Push debounce stable[167] 1 for config Secret/llm/e2e-apikey-failed-sa-dockercfg-mgc6h: 100.411202ms since last change, 100.411113ms since last push, full=false 2026-06-07T16:43:39.490020Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:35Z/90 2026-06-07T16:43:39.710832Z info ads Push debounce stable[168] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.245013ms since last change, 100.244947ms since last push, full=true 2026-06-07T16:43:39.714323Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:39Z/91 2026-06-07T16:43:39.714651Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:39.714654Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:39.717794Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:44.8kB 2026-06-07T16:43:47.619477Z info ads Push debounce stable[169] 2 for config Secret/llm/e2e-apikey-pending-sa-dockercfg-9v2m2: 100.221768ms since last change, 110.564826ms since last push, full=false 2026-06-07T16:43:47.619536Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:39Z/91 2026-06-07T16:43:49.012330Z info ads Push debounce stable[170] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.654555ms since last change, 100.654501ms since last push, full=true 2026-06-07T16:43:49.016156Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:49Z/92 2026-06-07T16:43:49.016509Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:49.016511Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:49.019397Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:50.416436Z info ads Push debounce stable[171] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.236721ms since last change, 100.236656ms since last push, full=true 2026-06-07T16:43:50.420379Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:50Z/93 2026-06-07T16:43:50.420814Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:50.420883Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:50.424380Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:51.919120Z info ads Push debounce stable[172] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.204568ms since last change, 100.204494ms since last push, full=true 2026-06-07T16:43:51.922891Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:51Z/94 2026-06-07T16:43:51.923234Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:51.923240Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:51.926230Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:52.914049Z info ads Push debounce stable[173] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.641813ms since last change, 100.641748ms since last push, full=true 2026-06-07T16:43:52.917808Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:52Z/95 2026-06-07T16:43:52.918208Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:52.918210Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:52.920969Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:53.716064Z info ads Push debounce stable[174] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.917733ms since last change, 100.917663ms since last push, full=true 2026-06-07T16:43:53.719854Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:53Z/96 2026-06-07T16:43:53.720260Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:53.720261Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:53.723619Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:54.707792Z info ads Push debounce stable[175] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.226749ms since last change, 100.226673ms since last push, full=true 2026-06-07T16:43:54.711601Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:54Z/97 2026-06-07T16:43:54.711968Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:54.711968Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:54.714712Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:55.602277Z info ads Push debounce stable[176] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.235505ms since last change, 100.235428ms since last push, full=true 2026-06-07T16:43:55.606094Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:55Z/98 2026-06-07T16:43:55.606441Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:55.606443Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:55.609215Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:56.405808Z info ads Push debounce stable[177] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.363878ms since last change, 100.363709ms since last push, full=true 2026-06-07T16:43:56.409799Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:56Z/99 2026-06-07T16:43:56.410143Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:56.410144Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:56.414888Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:57.313263Z info ads Push debounce stable[178] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.238934ms since last change, 100.238842ms since last push, full=true 2026-06-07T16:43:57.317252Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:57Z/100 2026-06-07T16:43:57.317580Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:57.317607Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:57.320979Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:58.211543Z info ads Push debounce stable[179] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.230626ms since last change, 100.230555ms since last push, full=true 2026-06-07T16:43:58.215327Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:58Z/101 2026-06-07T16:43:58.215703Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:58.215705Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:58.218486Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-07T16:43:58.834077Z info ads Push debounce stable[180] 1 for config Secret/llm/e2e-apikey-pending-sa-dockercfg-9v2m2: 100.662503ms since last change, 100.662452ms since last push, full=false 2026-06-07T16:43:58.834147Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:58Z/101 2026-06-07T16:43:59.601046Z info ads Push debounce stable[181] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 101.004585ms since last change, 101.004533ms since last push, full=true 2026-06-07T16:43:59.604571Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:43:59Z/102 2026-06-07T16:43:59.604971Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:43:59.604972Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:43:59.607736Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:44.8kB 2026-06-07T16:44:06.964790Z info ads Push debounce stable[182] 2 for config Secret/llm/e2e-apikey-unreconciled-sa-dockercfg-w9g8w: 100.28305ms since last change, 110.934019ms since last push, full=false 2026-06-07T16:44:06.964845Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:59Z/102 2026-06-07T16:44:07.421178Z info ads Push debounce stable[183] 1 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local: 100.527505ms since last change, 100.527435ms since last push, full=false 2026-06-07T16:44:07.421238Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:59Z/102 2026-06-07T16:44:07.593837Z info model Incremental push, service maas-controller-webhook-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-06-07T16:44:07.694115Z info ads Push debounce stable[184] 1 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local: 100.229989ms since last change, 100.229924ms since last push, full=false 2026-06-07T16:44:07.694170Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:59Z/102 2026-06-07T16:44:08.301880Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {} } } 2026-06-07T16:44:10.839583Z info ads Push debounce stable[185] 1 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local: 100.216839ms since last change, 100.216777ms since last push, full=false 2026-06-07T16:44:10.839659Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:59Z/102 2026-06-07T16:44:21.846259Z info ads Push debounce stable[186] 1 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local: 100.327351ms since last change, 100.327262ms since last push, full=false 2026-06-07T16:44:21.846330Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:59Z/102 2026-06-07T16:44:22.226208Z info ads Push debounce stable[187] 1 for config Secret/llm/e2e-apikey-unreconciled-sa-dockercfg-w9g8w: 100.227272ms since last change, 100.227211ms since last push, full=false 2026-06-07T16:44:22.226264Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:59Z/102 2026-06-07T16:44:23.919749Z info ads Push debounce stable[188] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.727211ms since last change, 100.727126ms since last push, full=false 2026-06-07T16:44:23.919832Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:59Z/102 2026-06-07T16:44:30.366899Z info ads Push debounce stable[189] 2 for config Secret/llm/e2e-filter-sa-69406a79-dockercfg-s5742: 100.166266ms since last change, 112.79254ms since last push, full=false 2026-06-07T16:44:30.366947Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:43:59Z/102 2026-06-07T16:44:32.106810Z info ads Push debounce stable[190] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.242946ms since last change, 100.242884ms since last push, full=true 2026-06-07T16:44:32.111549Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:44:32Z/103 2026-06-07T16:44:32.111907Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:44:32.111906Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:44:32.114958Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.1kB 2026-06-07T16:44:32.508033Z info ads Push debounce stable[191] 1 for config Secret/llm/e2e-filter-sa-69406a79-dockercfg-s5742: 100.122556ms since last change, 100.122493ms since last push, full=false 2026-06-07T16:44:32.508112Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:44:32Z/103 2026-06-07T16:44:34.197025Z info ads Push debounce stable[192] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.224995ms since last change, 100.224918ms since last push, full=true 2026-06-07T16:44:34.200452Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:44:34Z/104 2026-06-07T16:44:34.200797Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:44:34.200797Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:44:34.203888Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:44.8kB 2026-06-07T16:44:49.410198Z info ads Push debounce stable[193] 7 for config ConfigMap/e2e-api-unwatched-ns/kube-root-ca.crt and 3 more configs: 100.226484ms since last change, 140.817795ms since last push, full=false 2026-06-07T16:44:49.410256Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:44:34Z/104 2026-06-07T16:44:49.745122Z info ads Push debounce stable[194] 1 for config ServiceEntry/redhat-ai-gateway-infra/maas-api.redhat-ai-gateway-infra.svc.cluster.local: 100.675373ms since last change, 100.675308ms since last push, full=true 2026-06-07T16:44:49.745816Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:44:49Z/105 2026-06-07T16:44:49.746369Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:4 removed:0 size:1.6kB cached:0/1 2026-06-07T16:44:49.746454Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:211B empty:0 cached:0/1 2026-06-07T16:44:49.746374Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-06-07T16:44:49.746546Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:211B empty:0 cached:1/1 2026-06-07T16:44:49.746732Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:44:49.746744Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:44:49.746846Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:44:49.747176Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:19.1kB cached:0/0 2026-06-07T16:44:50.205149Z info ads Push debounce stable[195] 2 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 1 more configs: 101.060401ms since last change, 142.550569ms since last push, full=true 2026-06-07T16:44:50.205752Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:44:50Z/106 2026-06-07T16:44:50.206384Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:5 removed:0 size:2.7kB cached:0/2 2026-06-07T16:44:50.206497Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:2 removed:0 size:446B empty:0 cached:0/2 2026-06-07T16:44:50.206383Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-06-07T16:44:50.206602Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:2 removed:0 size:446B empty:0 cached:2/2 2026-06-07T16:44:50.206751Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:44:50.206863Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:44:50.207024Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:44:50.207200Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:19.1kB cached:0/0 2026-06-07T16:44:58.302432Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-06-07T16:45:03.018990Z info ads Push debounce stable[196] 3 for config Secret/e2e-api-unwatched-ns/builder-dockercfg-c48d9 and 2 more configs: 100.183282ms since last change, 105.390794ms since last push, full=false 2026-06-07T16:45:03.019077Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:44:50Z/106 2026-06-07T16:45:03.614574Z info ads Push debounce stable[197] 1 for config ConfigMap/e2e-api-unwatched-ns/kube-root-ca.crt: 100.063492ms since last change, 100.063422ms since last push, full=false 2026-06-07T16:45:03.614630Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:44:50Z/106 2026-06-07T16:45:12.903573Z info ads Push debounce stable[198] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.229898ms since last change, 100.229826ms since last push, full=true 2026-06-07T16:45:12.907322Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:12Z/107 2026-06-07T16:45:12.907655Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:12.907658Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:12.910491Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.3kB 2026-06-07T16:45:14.204718Z info ads Push debounce stable[199] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.043228ms since last change, 100.043156ms since last push, full=true 2026-06-07T16:45:14.208567Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:14Z/108 2026-06-07T16:45:14.208918Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:14.208935Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:14.211831Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.3kB 2026-06-07T16:45:15.611400Z info ads Push debounce stable[200] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.22946ms since last change, 100.229393ms since last push, full=true 2026-06-07T16:45:15.615232Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:15Z/109 2026-06-07T16:45:15.615548Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:15.615582Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:15.618739Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.3kB 2026-06-07T16:45:16.616890Z info ads Push debounce stable[201] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.263825ms since last change, 100.263705ms since last push, full=true 2026-06-07T16:45:16.620788Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:16Z/110 2026-06-07T16:45:16.621130Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:16.621143Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:16.624677Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.3kB 2026-06-07T16:45:17.505736Z info ads Push debounce stable[202] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.23257ms since last change, 100.232476ms since last push, full=true 2026-06-07T16:45:17.509571Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:17Z/111 2026-06-07T16:45:17.509943Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:17.509953Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:17.513125Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.3kB 2026-06-07T16:45:18.406016Z info ads Push debounce stable[203] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.872146ms since last change, 100.872069ms since last push, full=true 2026-06-07T16:45:18.409800Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:18Z/112 2026-06-07T16:45:18.410133Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:18.410135Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:18.413506Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.3kB 2026-06-07T16:45:19.412411Z info ads Push debounce stable[204] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.227363ms since last change, 100.2273ms since last push, full=true 2026-06-07T16:45:19.416236Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:19Z/113 2026-06-07T16:45:19.416561Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:19.416560Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:19.419411Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.3kB 2026-06-07T16:45:20.302504Z info ads Push debounce stable[205] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.320459ms since last change, 100.320394ms since last push, full=true 2026-06-07T16:45:20.306358Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:20Z/114 2026-06-07T16:45:20.306744Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:20.306744Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:20.309403Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.3kB 2026-06-07T16:45:21.406830Z info ads Push debounce stable[206] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.745662ms since last change, 100.74559ms since last push, full=true 2026-06-07T16:45:21.410881Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:21Z/115 2026-06-07T16:45:21.411267Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:21.411267Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:21.414388Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.3kB 2026-06-07T16:45:22.311098Z info ads Push debounce stable[207] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.915875ms since last change, 100.915809ms since last push, full=true 2026-06-07T16:45:22.314908Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:22Z/116 2026-06-07T16:45:22.315211Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:22.315210Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:22.317821Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:50.3kB 2026-06-07T16:45:28.405469Z info ads Push debounce stable[208] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.914571ms since last change, 100.914497ms since last push, full=true 2026-06-07T16:45:28.408826Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:28Z/117 2026-06-07T16:45:28.409162Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:28.409162Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:28.412453Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:44.8kB 2026-06-07T16:45:35.853013Z info ads Push debounce stable[209] 7 for config ConfigMap/e2e-unwatched-ns/kube-root-ca.crt and 3 more configs: 100.158619ms since last change, 142.649892ms since last push, full=false 2026-06-07T16:45:35.853090Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:45:28Z/117 2026-06-07T16:45:36.007528Z info ads Push debounce stable[210] 1 for config ServiceEntry/redhat-ai-gateway-infra/maas-api.redhat-ai-gateway-infra.svc.cluster.local: 100.738137ms since last change, 100.738064ms since last push, full=true 2026-06-07T16:45:36.008129Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:36Z/118 2026-06-07T16:45:36.008679Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:4 removed:0 size:1.6kB cached:0/1 2026-06-07T16:45:36.008704Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-06-07T16:45:36.008795Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:211B empty:0 cached:0/1 2026-06-07T16:45:36.008801Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:211B empty:0 cached:1/1 2026-06-07T16:45:36.009048Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:36.009058Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:36.009135Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:45:36.009546Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:19.1kB cached:0/0 2026-06-07T16:45:36.517439Z info ads Push debounce stable[211] 2 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.37003ms since last change, 141.846221ms since last push, full=true 2026-06-07T16:45:36.518076Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:45:36Z/119 2026-06-07T16:45:36.518742Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:5 removed:0 size:2.7kB cached:0/2 2026-06-07T16:45:36.518818Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-06-07T16:45:36.518910Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:2 removed:0 size:446B empty:0 cached:0/2 2026-06-07T16:45:36.518921Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:2 removed:0 size:446B empty:0 cached:1/2 2026-06-07T16:45:36.519166Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:45:36.519174Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:45:36.519258Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:45:36.519621Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:19.1kB cached:0/0 2026-06-07T16:45:38.301922Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-06-07T16:46:05.223082Z info ads Push debounce stable[212] 1 for config ConfigMap/e2e-unwatched-ns/kube-root-ca.crt: 100.306141ms since last change, 100.306047ms since last push, full=false 2026-06-07T16:46:05.223134Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:45:36Z/119 2026-06-07T16:46:05.369696Z info ads Push debounce stable[213] 3 for config Secret/e2e-unwatched-ns/builder-dockercfg-k9qk5 and 2 more configs: 100.245716ms since last change, 104.093396ms since last push, full=false 2026-06-07T16:46:05.369752Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:45:36Z/119 2026-06-07T16:46:05.838578Z info ads Push debounce stable[214] 7 for config ConfigMap/e2e-modelref-0c203c/kube-root-ca.crt and 3 more configs: 100.206852ms since last change, 132.872817ms since last push, full=false 2026-06-07T16:46:05.838658Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:45:36Z/119 2026-06-07T16:46:05.938359Z info model Cache Update, new service e2e-modelref-0c203c/test.example.com 2026-06-07T16:46:05.974527Z info model Cache Update, new service llm/test.example.com 2026-06-07T16:46:06.090347Z info ads Push debounce stable[215] 10 for config ServiceEntry/e2e-modelref-0c203c/test-backend.e2e-modelref-0c203c.svc.cluster.local and 6 more configs: 100.10393ms since last change, 162.606718ms since last push, full=true 2026-06-07T16:46:06.091066Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:06Z/120 2026-06-07T16:46:06.091718Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-06-07T16:46:06.091720Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-06-07T16:46:06.092460Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:06.092617Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:06.092824Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:06.092864Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:06.092926Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:46:06.093415Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:21.4kB cached:0/0 2026-06-07T16:46:07.209156Z info ads Push debounce stable[216] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.234122ms since last change, 100.234058ms since last push, full=true 2026-06-07T16:46:07.213093Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:07Z/121 2026-06-07T16:46:07.213437Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:07.213439Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:07.216680Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:51.1kB 2026-06-07T16:46:22.463012Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 2ceab1aa-fc8a-4a3f-90d6-dcffd64e5523 test-backend e2e-modelref-0c203c cluster.local map[app.kubernetes.io/managed-by:maas-external-model-reconciler maas.opendatahub.io/external-model:test-backend] map[] 30659 2026-06-07 16:46:05 +0000 UTC [{maas.opendatahub.io/v1alpha1 ExternalModel test-backend 99770360-990c-4af6-a6d8-b6189246848c 0xc001614847 0xc001614846}] 1} 0xc0012ca888 0xc003c8bbc8 map[]}, will try again later: httproutes.gateway.networking.k8s.io "test-backend" not found 2026-06-07T16:46:22.562102Z info ads Push debounce stable[217] 4 for config ServiceEntry/e2e-modelref-0c203c/test-backend.e2e-modelref-0c203c.svc.cluster.local and 3 more configs: 100.184619ms since last change, 102.025237ms since last push, full=true 2026-06-07T16:46:22.562830Z info ads XDS: Pushing Services:109 ConnectedEndpoints:2 Version:2026-06-07T16:46:22Z/122 2026-06-07T16:46:22.563523Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-06-07T16:46:22.563608Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-06-07T16:46:22.564345Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:22.564434Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:22.564708Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:22.564712Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:22.565138Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:46:22.565269Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:20.2kB cached:0/0 2026-06-07T16:46:22.580102Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute ce154122-db8a-4669-ac74-e1c425a0d7b3 test-backend llm cluster.local map[app.kubernetes.io/managed-by:maas-external-model-reconciler maas.opendatahub.io/external-model:test-backend] map[] 30660 2026-06-07 16:46:05 +0000 UTC [{maas.opendatahub.io/v1alpha1 ExternalModel test-backend 71d5c33a-02d3-4902-bf4a-307b27f606b4 0xc0067a8bb0 0xc0067a8b9f}] 1} 0xc001edf608 0xc000973248 map[]}, will try again later: httproutes.gateway.networking.k8s.io "test-backend" not found 2026-06-07T16:46:22.681569Z info ads Push debounce stable[218] 4 for config VirtualService/redhat-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 101.058673ms since last change, 104.686873ms since last push, full=true 2026-06-07T16:46:22.682240Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:46:22Z/123 2026-06-07T16:46:22.682712Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:3 removed:1 size:507B 2026-06-07T16:46:22.682727Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:1 size:44B 2026-06-07T16:46:22.683387Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:22.683471Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:22.683689Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:22.683732Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:22.683875Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:46:22.684212Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:19.1kB cached:0/0 2026-06-07T16:46:24.305683Z info ads Push debounce stable[219] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.231182ms since last change, 100.231109ms since last push, full=true 2026-06-07T16:46:24.309128Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:46:24Z/124 2026-06-07T16:46:24.309457Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:24.309458Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:24.311885Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:44.8kB 2026-06-07T16:46:27.854647Z info ads Push debounce stable[220] 3 for config Secret/e2e-modelref-0c203c/builder-dockercfg-lrzpp and 2 more configs: 100.955413ms since last change, 105.468874ms since last push, full=false 2026-06-07T16:46:27.854701Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:46:24Z/124 2026-06-07T16:46:28.268501Z info ads Push debounce stable[221] 1 for config ConfigMap/e2e-modelref-0c203c/kube-root-ca.crt: 100.22018ms since last change, 100.220105ms since last push, full=false 2026-06-07T16:46:28.268566Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:46:24Z/124 2026-06-07T16:46:36.664827Z info model Cache Update, new service e2e-modelref-8373d2/test.example.com 2026-06-07T16:46:36.781088Z info model Cache Update, new service llm/test.example.com 2026-06-07T16:46:36.901180Z info ads Push debounce stable[222] 17 for config ConfigMap/e2e-modelref-8373d2/kube-root-ca.crt and 10 more configs: 100.938993ms since last change, 369.164734ms since last push, full=true 2026-06-07T16:46:36.901927Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:36Z/125 2026-06-07T16:46:36.903406Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:138 removed:0 size:159.8kB cached:121/137 2026-06-07T16:46:36.903415Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:140 removed:0 size:160.3kB cached:121/137 2026-06-07T16:46:36.904120Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:36.904257Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:36.904442Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:36.904487Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:36.904577Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:46:36.904617Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-06-07T16:46:36.904876Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:21.4kB cached:0/0 2026-06-07T16:46:36.904912Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:3.2kB cached:1/1 2026-06-07T16:46:38.302705Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-06-07T16:46:38.405088Z info ads Push debounce stable[223] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 101.051106ms since last change, 101.051041ms since last push, full=true 2026-06-07T16:46:38.409393Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:38Z/126 2026-06-07T16:46:38.409840Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:38.409841Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:38.413464Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:40.617979Z info ads Push debounce stable[224] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.240203ms since last change, 100.240105ms since last push, full=true 2026-06-07T16:46:40.622223Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:40Z/127 2026-06-07T16:46:40.622569Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:40.622572Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:40.625844Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:42.405124Z info ads Push debounce stable[225] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.225838ms since last change, 100.225754ms since last push, full=true 2026-06-07T16:46:42.409358Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:42Z/128 2026-06-07T16:46:42.409798Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:42.409799Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:42.418752Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:43.509356Z info ads Push debounce stable[226] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.2358ms since last change, 100.235735ms since last push, full=true 2026-06-07T16:46:43.513812Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:43Z/129 2026-06-07T16:46:43.514171Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:43.514177Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:43.518119Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:44.719639Z info ads Push debounce stable[227] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.439748ms since last change, 100.439676ms since last push, full=true 2026-06-07T16:46:44.723945Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:44Z/130 2026-06-07T16:46:44.724333Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:44.724342Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:44.728155Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:45.812062Z info ads Push debounce stable[228] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.244182ms since last change, 100.244108ms since last push, full=true 2026-06-07T16:46:45.816422Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:45Z/131 2026-06-07T16:46:45.816795Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:45.816799Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:45.819795Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:47.110131Z info ads Push debounce stable[229] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.235048ms since last change, 100.234975ms since last push, full=true 2026-06-07T16:46:47.114361Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:47Z/132 2026-06-07T16:46:47.114699Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:47.114702Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:47.118290Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:48.218522Z info ads Push debounce stable[230] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.236868ms since last change, 100.236803ms since last push, full=true 2026-06-07T16:46:48.222730Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:48Z/133 2026-06-07T16:46:48.223071Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:48.223113Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:48.226054Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:49.516542Z info ads Push debounce stable[231] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.228008ms since last change, 100.227872ms since last push, full=true 2026-06-07T16:46:49.520800Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:49Z/134 2026-06-07T16:46:49.521128Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:49.521128Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:49.524273Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:50.611457Z info ads Push debounce stable[232] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.241078ms since last change, 100.240991ms since last push, full=true 2026-06-07T16:46:50.615774Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:50Z/135 2026-06-07T16:46:50.616145Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:50.616165Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:50.619746Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:51.714690Z info ads Push debounce stable[233] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.221492ms since last change, 100.221426ms since last push, full=true 2026-06-07T16:46:51.719399Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:51Z/136 2026-06-07T16:46:51.719785Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:51.719801Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:51.722859Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:52.910391Z info ads Push debounce stable[234] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.058806ms since last change, 100.05868ms since last push, full=true 2026-06-07T16:46:52.914655Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-07T16:46:52Z/137 2026-06-07T16:46:52.914993Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:52.914995Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:52.918640Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:56.6kB 2026-06-07T16:46:53.296709Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute a173310e-bcda-4e2c-b1f9-0907678e6851 test-backend e2e-modelref-8373d2 cluster.local map[app.kubernetes.io/managed-by:maas-external-model-reconciler maas.opendatahub.io/external-model:test-backend] map[] 31170 2026-06-07 16:46:36 +0000 UTC [{maas.opendatahub.io/v1alpha1 ExternalModel test-backend f7283151-0eb1-4b83-a4c9-aea053c4df45 0xc00605922d 0xc00605922c}] 1} 0xc004050888 0xc001750de8 map[]}, will try again later: httproutes.gateway.networking.k8s.io "test-backend" not found 2026-06-07T16:46:53.398583Z info ads Push debounce stable[235] 4 for config ServiceEntry/e2e-modelref-8373d2/test-backend.e2e-modelref-8373d2.svc.cluster.local and 3 more configs: 100.884279ms since last change, 110.188564ms since last push, full=true 2026-06-07T16:46:53.399308Z info ads XDS: Pushing Services:109 ConnectedEndpoints:2 Version:2026-06-07T16:46:53Z/138 2026-06-07T16:46:53.400046Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-06-07T16:46:53.400068Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-06-07T16:46:53.401033Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:53.401182Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:53.401347Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:53.401443Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:53.401562Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:46:53.401862Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:20.2kB cached:0/0 2026-06-07T16:46:53.404517Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute defa4016-0b43-4b1a-9861-beb26e5896fd test-backend llm cluster.local map[app.kubernetes.io/managed-by:maas-external-model-reconciler maas.opendatahub.io/external-model:test-backend] map[] 31169 2026-06-07 16:46:36 +0000 UTC [{maas.opendatahub.io/v1alpha1 ExternalModel test-backend f397e4d6-e848-48d7-889d-cbb4f41b1496 0xc006058f10 0xc006058eff}] 1} 0xc004050408 0xc00426d8c8 map[]}, will try again later: httproutes.gateway.networking.k8s.io "test-backend" not found 2026-06-07T16:46:53.503069Z info ads Push debounce stable[236] 4 for config VirtualService/redhat-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.325985ms since last change, 102.080616ms since last push, full=true 2026-06-07T16:46:53.503930Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:46:53Z/139 2026-06-07T16:46:53.504464Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:1 size:44B 2026-06-07T16:46:53.504466Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:3 removed:1 size:507B 2026-06-07T16:46:53.505188Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:53.505281Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-07T16:46:53.505481Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:53.505545Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:53.505589Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-07T16:46:53.506161Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:19.1kB cached:0/0 2026-06-07T16:46:54.304640Z info ads Push debounce stable[237] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.235058ms since last change, 100.234986ms since last push, full=true 2026-06-07T16:46:54.308147Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-07T16:46:54Z/140 2026-06-07T16:46:54.308471Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795fcb7z.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-07T16:46:54.308474Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:4.6kB 2026-06-07T16:46:54.311676Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-zhjwz.openshift-ingress resources:1 removed:0 size:44.8kB 2026-06-07T16:46:58.752081Z info ads Push debounce stable[238] 1 for config ConfigMap/e2e-modelref-8373d2/kube-root-ca.crt: 100.248548ms since last change, 100.248473ms since last push, full=false 2026-06-07T16:46:58.752152Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:46:54Z/140 2026-06-07T16:46:58.950096Z info ads Push debounce stable[239] 3 for config Secret/e2e-modelref-8373d2/builder-dockercfg-n2zv9 and 2 more configs: 100.21877ms since last change, 103.661901ms since last push, full=false 2026-06-07T16:46:58.950163Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-07T16:46:54Z/140