2026-07-14T18:17:12.013261Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-07-14T18:17:12.013327Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:107B empty:1 cached:0/1 2026-07-14T18:17:12.013391Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-14T18:17:12.013330Z info delta EDS: PUSH INC for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:107B empty:1 cached:0/1 2026-07-14T18:17:12.013507Z info delta EDS: PUSH INC for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 2026-07-14T18:17:12.013438Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-14T18:17:12.013740Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:12.013767Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 2026-07-14T18:17:12.013768Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:12.014139Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-14T18:17:12.013664Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:17:12.014213Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-14T18:17:12.014288Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:17:12.014417Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-14T18:17:12.015774Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0 2026-07-14T18:17:13.633391Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||rate-test-model-877bd7-kserve-workload-svc.ai-tenant-e2e-shared-b-877bd7.svc.cluster.local": {} } } 2026-07-14T18:17:15.461077Z info ads Push debounce stable[797] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-877bd7: 100.667104ms since last change, 100.667045ms since last push, full=true 2026-07-14T18:17:15.473670Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-14T18:17:15Z/418 2026-07-14T18:17:15.473987Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:17:15.474006Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:15.473993Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:15.473993Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-14T18:17:15.475903Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:30.5kB 2026-07-14T18:17:15.476179Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:30.5kB 2026-07-14T18:17:15.481713Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:17:19.118226Z info ads Push debounce stable[798] 1 for config Secret/opendatahub/maas-controller-dockercfg-vp5j2: 100.464085ms since last change, 100.46402ms since last push, full=false 2026-07-14T18:17:19.118271Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-14T18:17:15Z/418 2026-07-14T18:17:22.119797Z info ads Push debounce stable[799] 4 for config Secret/ai-tenants/deployer-dockercfg-2nkhc and 3 more configs: 100.163068ms since last change, 137.106227ms since last push, full=false 2026-07-14T18:17:22.119862Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-14T18:17:15Z/418 2026-07-14T18:17:29.093546Z info ads Push debounce stable[800] 1 for config Secret/ai-tenant-e2e-shared-b-877bd7/rate-test-model-877bd7-kserve-self-signed-certs: 100.285769ms since last change, 100.285695ms since last push, full=false 2026-07-14T18:17:29.093601Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-14T18:17:15Z/418 2026-07-14T18:17:31.077396Z info ads Push debounce stable[801] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.516008ms since last change, 232.782233ms since last push, full=true 2026-07-14T18:17:31.079073Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-14T18:17:31Z/419 2026-07-14T18:17:31.080512Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:142 removed:0 size:163.4kB cached:135/139 2026-07-14T18:17:31.080653Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:140 removed:0 size:162.9kB cached:135/139 2026-07-14T18:17:31.080850Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:142 removed:0 size:163.4kB cached:135/139 2026-07-14T18:17:31.080864Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:142 removed:0 size:163.4kB cached:135/139 2026-07-14T18:17:31.081783Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-14T18:17:31.081893Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-14T18:17:31.082149Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:31.082237Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:31.081903Z info delta EDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:138/139 2026-07-14T18:17:31.082416Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:138/139 2026-07-14T18:17:31.082587Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:17:31.082636Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-14T18:17:31.082688Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:17:31.082830Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:17:31.083060Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0 2026-07-14T18:17:31.084983Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:17:31.089692Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:30.5kB 2026-07-14T18:17:31.090371Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:30.5kB 2026-07-14T18:17:31.103576Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:17:33.633869Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-14T18:17:38.663651Z info ads Push debounce stable[802] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-877bd7: 100.278167ms since last change, 100.278089ms since last push, full=true 2026-07-14T18:17:38.677499Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-14T18:17:38Z/420 2026-07-14T18:17:38.677849Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:38.677859Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:17:38.677853Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:17:38.677852Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:38.680426Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:30.5kB 2026-07-14T18:17:38.680477Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-14T18:17:38.689878Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:17:39.088695Z info ads Push debounce stable[803] 4 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-aa324e and 3 more configs: 100.801624ms since last change, 233.614309ms since last push, full=true 2026-07-14T18:17:39.102712Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-14T18:17:39Z/421 2026-07-14T18:17:39.103960Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:142 removed:0 size:163.4kB cached:137/139 2026-07-14T18:17:39.104077Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:142 removed:0 size:163.4kB cached:137/139 2026-07-14T18:17:39.104386Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:140 removed:0 size:162.9kB cached:137/139 2026-07-14T18:17:39.104403Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:142 removed:0 size:163.4kB cached:137/139 2026-07-14T18:17:39.104694Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:137/139 2026-07-14T18:17:39.105113Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:17:39.105126Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-14T18:17:39.105498Z info delta EDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-14T18:17:39.105155Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-14T18:17:39.105697Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0 2026-07-14T18:17:39.105920Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:39.105710Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:17:39.106045Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:17:39.105739Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:39.106522Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-14T18:17:39.107073Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:17:39.108143Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-14T18:17:39.108454Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-14T18:17:39.113691Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:17:43.634067Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-14T18:17:53.856975Z info ads Push debounce stable[804] 2 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-aa324e and 1 more configs: 100.547343ms since last change, 187.612731ms since last push, full=true 2026-07-14T18:17:53.869687Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-14T18:17:53Z/422 2026-07-14T18:17:53.869999Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:17:53.870008Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:17:53.869999Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:53.870005Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:17:53.872155Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-14T18:17:53.872824Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-14T18:17:53.878293Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:17:54.126359Z info ads Push debounce stable[805] 3 for config Secret/models-as-a-service/deployer-dockercfg-2h4vm and 2 more configs: 100.333188ms since last change, 106.187111ms since last push, full=false 2026-07-14T18:17:54.126426Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-14T18:17:53Z/422 2026-07-14T18:17:55.122166Z info ads Push debounce stable[806] 3 for config Secret/odh-ai-gateway-infra/maas-api-cleanup-dockercfg-pd7w9 and 2 more configs: 100.324305ms since last change, 104.384797ms since last push, full=false 2026-07-14T18:17:55.122242Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-14T18:17:53Z/422 2026-07-14T18:18:00.019213Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 3cb660f8-15bd-4856-baff-2ec74348e53b rate-test-model-aa324e-kserve-route ai-tenant-e2e-shared-a-aa324e cluster.local map[app.kubernetes.io/component:llminferenceservice-router app.kubernetes.io/name:rate-test-model-aa324e app.kubernetes.io/part-of:llminferenceservice] map[] 61348 2026-07-14 18:16:37 +0000 UTC [{serving.kserve.io/v1alpha2 LLMInferenceService rate-test-model-aa324e b6eca36a-3ef7-4cb3-95ea-f9acea944f1d 0xc00607e797 0xc00607e796}] 1} 0xc001adf008 0xc00169fc08 map[]}, will try again later: httproutes.gateway.networking.k8s.io "rate-test-model-aa324e-kserve-route" not found 2026-07-14T18:18:00.019509Z info model Incremental push, service rate-test-model-aa324e-kserve-workload-svc.ai-tenant-e2e-shared-a-aa324e.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-14T18:18:00.119954Z info ads Push debounce stable[807] 6 for config Secret/ai-tenant-e2e-shared-a-aa324e/kserve-metrics-reader-sa-dockercfg-qqw7g and 4 more configs: 100.407123ms since last change, 208.507358ms since last push, full=true 2026-07-14T18:18:00.120635Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-14T18:18:00Z/423 2026-07-14T18:18:00.121021Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:1 size:44B 2026-07-14T18:18:00.121249Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:00.121360Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:00.121251Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:00.121823Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-14T18:18:00.122100Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-14T18:18:00.122168Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-14T18:18:00.122250Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:00.122372Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:00.122513Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:18:00.122394Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:00.122776Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-14T18:18:00.122271Z info delta EDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-14T18:18:00.123000Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0 2026-07-14T18:18:00.123074Z info delta SDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:00.123133Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:00.123283Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-14T18:18:00.123322Z info delta SDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:00.123650Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:00.123716Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:00.704055Z info ads Push debounce stable[808] 1 for config Secret/ai-tenant-e2e-shared-b-877bd7/kserve-metrics-reader-sa-dockercfg-mpxc2: 100.198391ms since last change, 100.19833ms since last push, full=false 2026-07-14T18:18:00.704105Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-14T18:18:00Z/423 2026-07-14T18:18:01.096158Z info model Incremental push, service rate-test-model-877bd7-kserve-workload-svc.ai-tenant-e2e-shared-b-877bd7.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-14T18:18:01.100503Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 2e904a20-5ec1-4eb5-bf2c-5cf8bbff588c rate-test-model-877bd7-kserve-route ai-tenant-e2e-shared-b-877bd7 cluster.local map[app.kubernetes.io/component:llminferenceservice-router app.kubernetes.io/name:rate-test-model-877bd7 app.kubernetes.io/part-of:llminferenceservice] map[] 61347 2026-07-14 18:17:10 +0000 UTC [{serving.kserve.io/v1alpha2 LLMInferenceService rate-test-model-877bd7 9ab4490a-f087-499d-9b5d-8037a6ae8790 0xc00167b45d 0xc00167b45c}] 1} 0xc003636408 0xc001ad0ec8 map[]}, will try again later: httproutes.gateway.networking.k8s.io "rate-test-model-877bd7-kserve-route" not found 2026-07-14T18:18:01.196930Z info ads Push debounce stable[809] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~e2e-shared-b-877bd7-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.742425ms since last change, 111.552498ms since last push, full=true 2026-07-14T18:18:01.197538Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-14T18:18:01Z/424 2026-07-14T18:18:01.198006Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:01.198103Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:1 size:44B 2026-07-14T18:18:01.198109Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:01.198317Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:01.198802Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:138 removed:0 size:33.3kB empty:1 cached:137/138 2026-07-14T18:18:01.199027Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:138 removed:0 size:33.3kB empty:1 cached:137/138 2026-07-14T18:18:01.199175Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:01.199299Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:138 removed:0 size:33.3kB empty:1 cached:137/138 2026-07-14T18:18:01.199031Z info delta EDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:138 removed:0 size:33.3kB empty:1 cached:137/138 2026-07-14T18:18:01.199484Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:01.199610Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:01.199630Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:18:01.199725Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:01.199796Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-14T18:18:01.199744Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-14T18:18:01.199897Z info delta SDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:01.199896Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-14T18:18:01.200025Z info delta SDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:01.200688Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:01.200777Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:03.633824Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-14T18:18:06.123068Z info ads Push debounce stable[810] 3 for config Secret/llm/builder-dockercfg-ptqfb and 2 more configs: 100.1478ms since last change, 103.045079ms since last push, full=false 2026-07-14T18:18:06.123116Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-14T18:18:01Z/424 2026-07-14T18:18:07.444368Z info ads Push debounce stable[811] 2 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-aa324e and 1 more configs: 100.475617ms since last change, 194.68565ms since last push, full=true 2026-07-14T18:18:07.454657Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-14T18:18:07Z/425 2026-07-14T18:18:07.454980Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:07.455483Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:07.455516Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:07.455535Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:18:07.457042Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:07.457318Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:07.471502Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:18:14.124229Z info ads Push debounce stable[812] 1 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-jvx8g: 100.219832ms since last change, 100.219771ms since last push, full=false 2026-07-14T18:18:14.124280Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-14T18:18:07Z/425 2026-07-14T18:18:21.372029Z info ads Push debounce stable[813] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.96431ms since last change, 100.964233ms since last push, full=true 2026-07-14T18:18:21.372664Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-14T18:18:21Z/426 2026-07-14T18:18:21.373324Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-07-14T18:18:21.373374Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:4 removed:0 size:1.6kB cached:0/1 2026-07-14T18:18:21.373441Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:219B empty:0 cached:0/1 2026-07-14T18:18:21.373447Z info delta EDS: PUSH INC for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:219B empty:0 cached:1/1 2026-07-14T18:18:21.373485Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:4 removed:0 size:1.6kB cached:0/1 2026-07-14T18:18:21.373540Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:4 removed:0 size:1.6kB cached:0/1 2026-07-14T18:18:21.373552Z info delta EDS: PUSH INC for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:219B empty:0 cached:1/1 2026-07-14T18:18:21.373601Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:219B empty:0 cached:1/1 2026-07-14T18:18:21.373715Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:21.373776Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:18:21.373801Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:21.373981Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-14T18:18:21.374024Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-14T18:18:21.373815Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:21.373830Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:21.375569Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:21.544857Z info ads Push debounce stable[814] 2 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.015249ms since last change, 158.137656ms since last push, full=true 2026-07-14T18:18:21.546161Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-14T18:18:21Z/427 2026-07-14T18:18:21.547532Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:140 removed:0 size:160.7kB cached:136/137 2026-07-14T18:18:21.547550Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:138 removed:0 size:160.3kB cached:136/137 2026-07-14T18:18:21.547697Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:140 removed:0 size:160.7kB cached:136/137 2026-07-14T18:18:21.547783Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:140 removed:0 size:160.7kB cached:136/137 2026-07-14T18:18:21.548261Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:136/137 2026-07-14T18:18:21.548498Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-14T18:18:21.548575Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:21.548882Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:21.549036Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:21.549125Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-14T18:18:21.549126Z info delta EDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-14T18:18:21.549443Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:21.549549Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:18:21.549645Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-14T18:18:21.549797Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-14T18:18:21.549980Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:21.550526Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:21.550787Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:21.556684Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:18:23.633562Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-14T18:18:31.298690Z info model Incremental push, service maas-api-e2e-shared-a-aa324e.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-14T18:18:31.445329Z info ads Push debounce stable[815] 5 for config Secret/odh-ai-gateway-infra/maas-api-e2e-shared-a-aa324e-serving-cert and 3 more configs: 100.975838ms since last change, 153.740857ms since last push, full=true 2026-07-14T18:18:31.445949Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-14T18:18:31Z/428 2026-07-14T18:18:31.446459Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:31.446473Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:1 size:44B 2026-07-14T18:18:31.446540Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:31.446699Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:31.447456Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-14T18:18:31.447604Z info delta EDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-14T18:18:31.447661Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-14T18:18:31.447777Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:31.447917Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:18:31.447987Z warn constructed http route config for route https.443.default.e2e-shared-a-aa324e-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-14T18:18:31.448021Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-14T18:18:31.447456Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-14T18:18:31.448391Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:31.447925Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:31.448983Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-14T18:18:31.447933Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:31.449267Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-14T18:18:31.449348Z info delta SDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:31.448058Z info delta SDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:31.449863Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:31.449946Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:33.633392Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-14T18:18:34.638106Z info ads Push debounce stable[816] 1 for config EnvoyFilter/openshift-ingress/kuadrant-auth-e2e-shared-a-aa324e: 100.215504ms since last change, 100.215404ms since last push, full=true 2026-07-14T18:18:34.638325Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-14T18:18:34Z/429 2026-07-14T18:18:34.639175Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:137 removed:0 size:159.1kB cached:136/136 2026-07-14T18:18:34.639436Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:139 removed:0 size:159.6kB cached:132/136 2026-07-14T18:18:34.639503Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:139 removed:0 size:159.6kB cached:136/136 2026-07-14T18:18:34.639502Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:139 removed:0 size:159.6kB cached:136/136 2026-07-14T18:18:34.639839Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-14T18:18:34.640249Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:34.640319Z info delta EDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-14T18:18:34.640459Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:34.640538Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-14T18:18:34.640585Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:18:34.640610Z warn constructed http route config for route https.443.default.e2e-shared-a-aa324e-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-14T18:18:34.640692Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-14T18:18:34.640790Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:34.640988Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-14T18:18:34.641559Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:34.641926Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:34.642244Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-14T18:18:34.642465Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:34.643774Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:34.650424Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:18:34.839348Z info ads Push debounce stable[817] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-shared-a-aa324e: 100.862782ms since last change, 100.862709ms since last push, full=true 2026-07-14T18:18:34.839595Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-14T18:18:34Z/430 2026-07-14T18:18:34.840554Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:139 removed:0 size:159.6kB cached:136/136 2026-07-14T18:18:34.840601Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:137 removed:0 size:159.1kB cached:136/136 2026-07-14T18:18:34.840560Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:139 removed:0 size:159.6kB cached:136/136 2026-07-14T18:18:34.841130Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:138 removed:1 size:159.4kB cached:129/136 2026-07-14T18:18:34.841364Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-14T18:18:34.841435Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-14T18:18:34.841653Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:34.841819Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-14T18:18:34.842105Z info delta EDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-14T18:18:34.841658Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:34.842418Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-14T18:18:34.842483Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:18:34.842563Z warn constructed http route config for route https.443.default.e2e-shared-a-aa324e-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-14T18:18:34.842622Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-14T18:18:34.842207Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:34.843072Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:34.843310Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:34.843347Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:34.843077Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:34.849864Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:18:35.051461Z info ads Push debounce stable[818] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-aa324e: 100.204071ms since last change, 100.203998ms since last push, full=true 2026-07-14T18:18:35.061021Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-14T18:18:35Z/431 2026-07-14T18:18:35.061354Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:35.061368Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:35.061355Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:35.061367Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-14T18:18:35.061685Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:0 removed:0 size:0B 2026-07-14T18:18:35.061998Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:35.068676Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:18:41.047604Z info ads Push debounce stable[819] 3 for config Secret/ai-tenant-e2e-shared-a-aa324e/builder-dockercfg-vqkzc and 2 more configs: 100.247819ms since last change, 110.994586ms since last push, full=false 2026-07-14T18:18:41.047675Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-14T18:18:35Z/431 2026-07-14T18:18:41.408880Z info ads Push debounce stable[820] 1 for config ConfigMap/ai-tenant-e2e-shared-a-aa324e/kube-root-ca.crt: 100.788428ms since last change, 100.788359ms since last push, full=false 2026-07-14T18:18:41.408950Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-14T18:18:35Z/431 2026-07-14T18:18:42.352494Z info ads Push debounce stable[821] 1 for config Gateway/openshift-ingress/e2e-shared-a-aa324e-istio-autogenerated-k8s-gateway-https: 100.215955ms since last change, 100.215874ms since last push, full=true 2026-07-14T18:18:42.352605Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-14T18:18:42Z/432 2026-07-14T18:18:42.352941Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:42.352948Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:42.352945Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:42.353047Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:42.353139Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-14T18:18:42.353137Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-14T18:18:42.353267Z warn constructed http route config for route https.443.default.e2e-shared-a-aa324e-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-14T18:18:42.353299Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-14T18:18:42.354013Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:46.516996Z info model Incremental push, service e2e-shared-a-aa324e-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-14T18:18:46.617277Z info ads Push debounce stable[822] 6 for config Gateway/openshift-ingress/e2e-shared-a-aa324e-istio-autogenerated-k8s-gateway-https and 4 more configs: 100.242111ms since last change, 123.953476ms since last push, full=true 2026-07-14T18:18:46.617928Z info ads XDS: Pushing Services:105 ConnectedEndpoints:4 Version:2026-07-14T18:18:46Z/433 2026-07-14T18:18:46.619146Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:135 removed:2 size:156.5kB cached:134/134 2026-07-14T18:18:46.619227Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:135 removed:3 size:156.5kB cached:134/134 2026-07-14T18:18:46.619358Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:137 removed:2 size:156.9kB cached:134/134 2026-07-14T18:18:46.619434Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:137 removed:2 size:156.9kB cached:134/134 2026-07-14T18:18:46.620103Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-14T18:18:46.620221Z info delta EDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-14T18:18:46.620385Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:0 removed:1 size:0B 2026-07-14T18:18:46.620447Z warn buildGatewayRoutes: no gateways for router e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress 2026-07-14T18:18:46.620404Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-14T18:18:46.620531Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-14T18:18:46.620649Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-14T18:18:46.620450Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:46.620680Z warn ads proxy e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress attempted to access unauthorized certificates e2e-shared-a-aa324e-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-14T18:18:46.620724Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:0 removed:0 size:0B 2026-07-14T18:18:46.620791Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:46.620841Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-14T18:18:46.620944Z info delta SDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:46.621169Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:46.621313Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:46.621442Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-14T18:18:46.621781Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:46.622235Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:46.622288Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:46.631014Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:18:47.678610Z info ads Push debounce stable[823] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.337808ms since last change, 177.017544ms since last push, full=true 2026-07-14T18:18:47.679927Z info ads XDS: Pushing Services:105 ConnectedEndpoints:4 Version:2026-07-14T18:18:47Z/434 2026-07-14T18:18:47.681112Z info delta CDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:135 removed:0 size:156.5kB cached:132/134 2026-07-14T18:18:47.681363Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:135 removed:0 size:156.5kB cached:134/134 2026-07-14T18:18:47.681567Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:137 removed:0 size:156.9kB cached:132/134 2026-07-14T18:18:47.681580Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:137 removed:0 size:156.9kB cached:132/134 2026-07-14T18:18:47.682124Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:133/134 2026-07-14T18:18:47.682213Z info delta EDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:132/134 2026-07-14T18:18:47.682334Z info delta LDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:0 removed:0 size:0B 2026-07-14T18:18:47.682378Z warn buildGatewayRoutes: no gateways for router e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress 2026-07-14T18:18:47.682440Z info delta RDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-14T18:18:47.682481Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:47.682501Z info delta ECDS: PUSH for node:e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress resources:0 removed:0 size:0B 2026-07-14T18:18:47.682633Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:47.682779Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:134/134 2026-07-14T18:18:47.683026Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:47.683623Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:134/134 2026-07-14T18:18:47.684067Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:18:47.684305Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:47.684415Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-14T18:18:47.685145Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:18:47.696069Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:18:51.535789Z info delta ADS: "10.134.0.37:40818" e2e-shared-a-aa324e-openshift-default-686754ddc9-zzml5.openshift-ingress-28 terminated 2026-07-14T18:18:53.633403Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-14T18:18:57.405912Z info model Incremental push, service maas-api-e2e-shared-b-877bd7.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-14T18:18:57.548292Z info ads Push debounce stable[824] 5 for config ServiceEntry/odh-ai-gateway-infra/maas-api-e2e-shared-b-877bd7.odh-ai-gateway-infra.svc.cluster.local and 3 more configs: 100.575783ms since last change, 156.580769ms since last push, full=true 2026-07-14T18:18:57.548980Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-14T18:18:57Z/435 2026-07-14T18:18:57.549599Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:57.549627Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:3 removed:1 size:507B 2026-07-14T18:18:57.549635Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:1 size:44B 2026-07-14T18:18:57.550390Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:134 removed:0 size:32.2kB empty:1 cached:133/134 2026-07-14T18:18:57.550428Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:134 removed:0 size:32.2kB empty:1 cached:133/134 2026-07-14T18:18:57.550552Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:134 removed:0 size:32.2kB empty:1 cached:133/134 2026-07-14T18:18:57.550686Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:18:57.550793Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:18:57.550846Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:18:57.550930Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-14T18:18:57.550696Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:18:57.550880Z warn constructed http route config for route https.443.default.e2e-shared-b-877bd7-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-14T18:18:57.551111Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-14T18:18:57.551176Z info delta SDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:18:57.552250Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:18:57.552301Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:19:00.141234Z info ads Push debounce stable[825] 1 for config EnvoyFilter/openshift-ingress/kuadrant-auth-e2e-shared-b-877bd7: 100.188627ms since last change, 100.188522ms since last push, full=true 2026-07-14T18:19:00.141446Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-14T18:19:00Z/436 2026-07-14T18:19:00.142265Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:134 removed:0 size:155.3kB cached:133/133 2026-07-14T18:19:00.142300Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:136 removed:0 size:155.8kB cached:133/133 2026-07-14T18:19:00.142383Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:136 removed:0 size:155.8kB cached:131/133 2026-07-14T18:19:00.143144Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-14T18:19:00.143241Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-14T18:19:00.143498Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:19:00.143144Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-14T18:19:00.143535Z warn constructed http route config for route https.443.default.e2e-shared-b-877bd7-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-14T18:19:00.143505Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:19:00.143569Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-14T18:19:00.143705Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:19:00.143737Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:19:00.144349Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:19:00.144715Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:19:00.151071Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:19:00.342259Z info ads Push debounce stable[826] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-shared-b-877bd7: 100.313139ms since last change, 100.313006ms since last push, full=true 2026-07-14T18:19:00.342468Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-14T18:19:00Z/437 2026-07-14T18:19:00.343308Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:134 removed:0 size:155.3kB cached:133/133 2026-07-14T18:19:00.343448Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:135 removed:1 size:155.6kB cached:129/133 2026-07-14T18:19:00.343311Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:136 removed:0 size:155.8kB cached:133/133 2026-07-14T18:19:00.344055Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-14T18:19:00.344411Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-14T18:19:00.344424Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:19:00.344523Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-14T18:19:00.344567Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:19:00.344672Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:19:00.344813Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-14T18:19:00.344880Z warn constructed http route config for route https.443.default.e2e-shared-b-877bd7-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-14T18:19:00.344946Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-14T18:19:00.345865Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-14T18:19:00.345927Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:19:00.352247Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:19:00.850650Z info ads Push debounce stable[827] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-877bd7: 100.231248ms since last change, 100.231193ms since last push, full=true 2026-07-14T18:19:00.859681Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-14T18:19:00Z/438 2026-07-14T18:19:00.859976Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-14T18:19:00.860015Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:0 removed:0 size:0B 2026-07-14T18:19:00.859974Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:19:00.859974Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:19:00.867541Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:19:07.172460Z info ads Push debounce stable[828] 1 for config ConfigMap/ai-tenant-e2e-shared-b-877bd7/kube-root-ca.crt: 100.207188ms since last change, 100.20712ms since last push, full=false 2026-07-14T18:19:07.172512Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-14T18:19:00Z/438 2026-07-14T18:19:08.043962Z info ads Push debounce stable[829] 3 for config Secret/ai-tenant-e2e-shared-b-877bd7/builder-dockercfg-wnvfx and 2 more configs: 100.288595ms since last change, 106.899773ms since last push, full=false 2026-07-14T18:19:08.044026Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-14T18:19:00Z/438 2026-07-14T18:19:09.030710Z info ads Push debounce stable[830] 1 for config Gateway/openshift-ingress/e2e-shared-b-877bd7-istio-autogenerated-k8s-gateway-https: 100.208978ms since last change, 100.208912ms since last push, full=true 2026-07-14T18:19:09.030830Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-14T18:19:09Z/439 2026-07-14T18:19:09.031131Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-14T18:19:09.031161Z warn constructed http route config for route https.443.default.e2e-shared-b-877bd7-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-14T18:19:09.031212Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-14T18:19:09.031128Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:19:09.031355Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:19:09.031128Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:19:09.032395Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:19:12.748929Z info model Incremental push, service e2e-shared-b-877bd7-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-14T18:19:12.851592Z info ads Push debounce stable[831] 6 for config Gateway/openshift-ingress/e2e-shared-b-877bd7-istio-autogenerated-k8s-gateway-https and 4 more configs: 100.538108ms since last change, 152.912294ms since last push, full=true 2026-07-14T18:19:12.852259Z info ads XDS: Pushing Services:103 ConnectedEndpoints:3 Version:2026-07-14T18:19:12Z/440 2026-07-14T18:19:12.853297Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:132 removed:2 size:152.7kB cached:131/131 2026-07-14T18:19:12.853321Z info delta CDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:132 removed:3 size:152.7kB cached:131/131 2026-07-14T18:19:12.853332Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:134 removed:2 size:153.1kB cached:131/131 2026-07-14T18:19:12.854294Z info delta EDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-14T18:19:12.854352Z info delta LDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:0 removed:1 size:0B 2026-07-14T18:19:12.854371Z warn buildGatewayRoutes: no gateways for router e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress 2026-07-14T18:19:12.854397Z info delta RDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-14T18:19:12.854447Z warn ads proxy e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress attempted to access unauthorized certificates e2e-shared-b-877bd7-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-14T18:19:12.854507Z info delta ECDS: PUSH for node:e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress resources:0 removed:0 size:0B 2026-07-14T18:19:12.854457Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-14T18:19:12.854458Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-14T18:19:12.854925Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-14T18:19:12.854938Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-14T18:19:12.855166Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-14T18:19:12.855238Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf46rt48.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-14T18:19:12.856296Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-14T18:19:12.856344Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-14T18:19:12.868142Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-14T18:19:13.634083Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-prdwh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-14T18:19:17.773913Z info delta ADS: "10.134.0.38:56198" e2e-shared-b-877bd7-openshift-default-5cc7bb575-b5shn.openshift-ingress-29 terminated