2026-07-22T01:16:14.964197Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-22T01:16:14.964539Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:16:14.965466Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:26.5kB 2026-07-22T01:16:14.965693Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:26.5kB 2026-07-22T01:16:14.971096Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:16:17.024295Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-22T01:16:18.420484Z info ads Push debounce stable[854] 1 for config ServiceEntry/ai-tenant-e2e-shared-b-4f35c1/rate-test-model-4f35c1-kserve-workload-svc.ai-tenant-e2e-shared-b-4f35c1.svc.cluster.local: 100.04102ms since last change, 100.040959ms since last push, full=false 2026-07-22T01:16:18.420544Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:16:14Z/488 2026-07-22T01:16:18.563565Z info ads Push debounce stable[855] 1 for config Secret/ai-tenant-e2e-shared-b-4f35c1/rate-test-model-4f35c1-kserve-self-signed-certs: 100.232748ms since last change, 100.232684ms since last push, full=false 2026-07-22T01:16:18.563641Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:16:14Z/488 2026-07-22T01:16:20.114744Z info ads Push debounce stable[856] 1 for config Secret/opendatahub/maas-controller-dockercfg-qrk2k: 100.218349ms since last change, 100.218278ms since last push, full=false 2026-07-22T01:16:20.114807Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:16:14Z/488 2026-07-22T01:16:24.117501Z info ads Push debounce stable[857] 3 for config Secret/ai-tenants/builder-dockercfg-kd7rj and 2 more configs: 100.771056ms since last change, 102.56131ms since last push, full=false 2026-07-22T01:16:24.117555Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:16:14Z/488 2026-07-22T01:16:26.637543Z info ads Push debounce stable[858] 1 for config EnvoyFilter/openshift-ingress/kuadrant-auth-e2e-shared-a-e4b9ac: 100.227037ms since last change, 100.226967ms since last push, full=true 2026-07-22T01:16:26.638036Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-22T01:16:26Z/489 2026-07-22T01:16:26.640269Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:142 removed:0 size:163.4kB cached:138/139 2026-07-22T01:16:26.640350Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:142 removed:0 size:163.4kB cached:138/139 2026-07-22T01:16:26.640869Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:140 removed:0 size:162.9kB cached:138/139 2026-07-22T01:16:26.641137Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-22T01:16:26.641360Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-22T01:16:26.641383Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:26.641725Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-22T01:16:26.641747Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:26.641906Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0 2026-07-22T01:16:26.641915Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:26.642124Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:16:26.643128Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:16:26.643464Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:26.5kB 2026-07-22T01:16:26.644534Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:142 removed:0 size:163.4kB cached:0/139 2026-07-22T01:16:26.645185Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-22T01:16:26.645408Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:26.645741Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-22T01:16:26.648180Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:26.5kB 2026-07-22T01:16:26.652233Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:16:26.928971Z info ads Push debounce stable[859] 1 for config EnvoyFilter/openshift-ingress/kuadrant-auth-e2e-shared-b-4f35c1: 100.216047ms since last change, 100.21592ms since last push, full=true 2026-07-22T01:16:26.929465Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-22T01:16:26Z/490 2026-07-22T01:16:26.931342Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:140 removed:0 size:162.9kB cached:139/139 2026-07-22T01:16:26.931389Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:142 removed:0 size:163.4kB cached:139/139 2026-07-22T01:16:26.931344Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:142 removed:0 size:163.4kB cached:139/139 2026-07-22T01:16:26.932224Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-22T01:16:26.932371Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-22T01:16:26.932546Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:26.932644Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:26.932375Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-22T01:16:26.932735Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:16:26.932862Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-22T01:16:26.932964Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:26.934208Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:26.5kB 2026-07-22T01:16:26.934273Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:16:26.935504Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:142 removed:0 size:163.4kB cached:0/139 2026-07-22T01:16:26.936181Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-22T01:16:26.936416Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:26.936875Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0 2026-07-22T01:16:26.939240Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:26.5kB 2026-07-22T01:16:26.943192Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:16:27.024745Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-22T01:16:28.243635Z info ads Push debounce stable[860] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-e4b9ac: 100.427909ms since last change, 100.427847ms since last push, full=true 2026-07-22T01:16:28.257059Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-22T01:16:28Z/491 2026-07-22T01:16:28.257419Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:28.257434Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:28.257419Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:28.257669Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:28.260007Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:28.260380Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:28.264311Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:16:28.343995Z info ads Push debounce stable[861] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4f35c1: 100.250569ms since last change, 100.250521ms since last push, full=true 2026-07-22T01:16:28.365113Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-22T01:16:28Z/492 2026-07-22T01:16:28.365481Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:28.365553Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:28.365567Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:28.365483Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:28.368291Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:28.368711Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:28.372325Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:16:38.757452Z info ads Push debounce stable[862] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4f35c1: 100.218065ms since last change, 100.218004ms since last push, full=true 2026-07-22T01:16:38.770684Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-22T01:16:38Z/493 2026-07-22T01:16:38.770999Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:38.771000Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:38.771023Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:38.771068Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:38.772507Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:38.772548Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:38.778075Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:16:38.939779Z info ads Push debounce stable[863] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-e4b9ac: 100.218641ms since last change, 100.21859ms since last push, full=true 2026-07-22T01:16:38.953347Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-22T01:16:38Z/494 2026-07-22T01:16:38.953704Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:38.953728Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:38.953702Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:38.953703Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:38.955386Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:38.956466Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:38.961273Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:16:40.760703Z info ads Push debounce stable[864] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.051973ms since last change, 183.671744ms since last push, full=true 2026-07-22T01:16:40.762208Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-22T01:16:40Z/495 2026-07-22T01:16:40.763544Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:140 removed:0 size:162.9kB cached:137/139 2026-07-22T01:16:40.763706Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:142 removed:0 size:163.4kB cached:137/139 2026-07-22T01:16:40.763960Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:142 removed:0 size:163.4kB cached:137/139 2026-07-22T01:16:40.764246Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:142 removed:0 size:163.4kB cached:137/139 2026-07-22T01:16:40.764389Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:137/139 2026-07-22T01:16:40.764505Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:137/139 2026-07-22T01:16:40.764708Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:40.764816Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:16:40.764825Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-22T01:16:40.764979Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:139 removed:0 size:33.7kB empty:0 cached:139/139 2026-07-22T01:16:40.765114Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:40.765116Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:40.765238Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:40.765534Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-22T01:16:40.765539Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-22T01:16:40.766254Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-22T01:16:40.767265Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:40.767267Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:40.772736Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:16:47.024437Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-22T01:16:53.818327Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 07c6a13d-9090-4f23-9e78-fdb9908389ef rate-test-model-e4b9ac-kserve-route ai-tenant-e2e-shared-a-e4b9ac cluster.local map[app.kubernetes.io/component:llminferenceservice-router app.kubernetes.io/name:rate-test-model-e4b9ac app.kubernetes.io/part-of:llminferenceservice] map[] 64775 2026-07-22 01:15:37 +0000 UTC [{serving.kserve.io/v1alpha2 LLMInferenceService rate-test-model-e4b9ac 6592658c-1f7a-4b4f-a90d-add4e0f01e4f 0xc005bad0a7 0xc005bad0a6}] 1} 0xc00350b788 0xc000b92548 map[]}, will try again later: httproutes.gateway.networking.k8s.io "rate-test-model-e4b9ac-kserve-route" not found 2026-07-22T01:16:53.821876Z info model Incremental push, service rate-test-model-e4b9ac-kserve-workload-svc.ai-tenant-e2e-shared-a-e4b9ac.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-22T01:16:53.922120Z info ads Push debounce stable[865] 6 for config Secret/ai-tenant-e2e-shared-a-e4b9ac/rate-test-model-e4b9ac-kserve-self-signed-certs and 4 more configs: 100.196976ms since last change, 174.408178ms since last push, full=true 2026-07-22T01:16:53.922893Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-22T01:16:53Z/496 2026-07-22T01:16:53.923435Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:16:53.923435Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:1 size:44B 2026-07-22T01:16:53.923669Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:16:53.923588Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:16:53.924551Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-22T01:16:53.924559Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-22T01:16:53.924707Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-22T01:16:53.924792Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-22T01:16:53.924990Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:53.925025Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:53.925034Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:53.925099Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:53.925131Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:16:53.925172Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-22T01:16:53.925190Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-22T01:16:53.925231Z info delta SDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:16:53.925359Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-22T01:16:53.925388Z info delta SDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:16:53.926207Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-22T01:16:53.926250Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:16:54.588799Z info ads Push debounce stable[866] 1 for config Secret/ai-tenant-e2e-shared-b-4f35c1/kserve-metrics-reader-sa-dockercfg-w9wfh: 100.214702ms since last change, 100.214642ms since last push, full=false 2026-07-22T01:16:54.588853Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:16:53Z/496 2026-07-22T01:16:54.717338Z info model Incremental push, service rate-test-model-4f35c1-kserve-workload-svc.ai-tenant-e2e-shared-b-4f35c1.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-22T01:16:54.720750Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 0e1c8a9e-6383-4f01-b996-ee7e7252a2c8 rate-test-model-4f35c1-kserve-route ai-tenant-e2e-shared-b-4f35c1 cluster.local map[app.kubernetes.io/component:llminferenceservice-router app.kubernetes.io/name:rate-test-model-4f35c1 app.kubernetes.io/part-of:llminferenceservice] map[] 64774 2026-07-22 01:16:07 +0000 UTC [{serving.kserve.io/v1alpha2 LLMInferenceService rate-test-model-4f35c1 858f5e81-de04-4bde-a046-a74c0e5e9c62 0xc005bac987 0xc005bac986}] 1} 0xc00350b308 0xc005364548 map[]}, will try again later: httproutes.gateway.networking.k8s.io "rate-test-model-4f35c1-kserve-route" not found 2026-07-22T01:16:54.818303Z info ads Push debounce stable[867] 5 for config ServiceEntry/ai-tenant-e2e-shared-b-4f35c1/rate-test-model-4f35c1-kserve-workload-svc.ai-tenant-e2e-shared-b-4f35c1.svc.cluster.local and 3 more configs: 100.927516ms since last change, 111.38689ms since last push, full=true 2026-07-22T01:16:54.819073Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-22T01:16:54Z/497 2026-07-22T01:16:54.819628Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:16:54.819657Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:16:54.819728Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:1 size:44B 2026-07-22T01:16:54.819768Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:16:54.820484Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:138 removed:0 size:33.2kB empty:1 cached:137/138 2026-07-22T01:16:54.820525Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:138 removed:0 size:33.2kB empty:1 cached:137/138 2026-07-22T01:16:54.820804Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:54.820813Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:138 removed:0 size:33.2kB empty:1 cached:137/138 2026-07-22T01:16:54.820817Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:54.820833Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:138 removed:0 size:33.2kB empty:1 cached:137/138 2026-07-22T01:16:54.820953Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-22T01:16:54.821004Z info delta SDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:16:54.821067Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:54.821166Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:16:54.821206Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:54.821211Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-22T01:16:54.821405Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-22T01:16:54.821445Z info delta SDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:16:54.822107Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-22T01:16:54.822151Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:16:56.119000Z info ads Push debounce stable[868] 5 for config Secret/models-as-a-service/default-dockercfg-k5n2t and 4 more configs: 100.341225ms since last change, 103.342152ms since last push, full=false 2026-07-22T01:16:56.119062Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:16:54Z/497 2026-07-22T01:16:57.023920Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-22T01:16:57.115558Z info ads Push debounce stable[869] 1 for config Secret/openshift-ingress/payload-processing-dockercfg-bdj8v: 100.640421ms since last change, 100.640337ms since last push, full=false 2026-07-22T01:16:57.115638Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:16:54Z/497 2026-07-22T01:16:59.029188Z info ads Push debounce stable[870] 2 for config EnvoyFilter/openshift-ingress/kuadrant-auth-e2e-shared-a-e4b9ac and 1 more configs: 100.842226ms since last change, 197.576164ms since last push, full=true 2026-07-22T01:16:59.029436Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-22T01:16:59Z/498 2026-07-22T01:16:59.030627Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:138 removed:0 size:160.3kB cached:137/137 2026-07-22T01:16:59.030629Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:140 removed:0 size:160.7kB cached:137/137 2026-07-22T01:16:59.030838Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:140 removed:0 size:160.7kB cached:135/137 2026-07-22T01:16:59.030771Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:140 removed:0 size:160.7kB cached:135/137 2026-07-22T01:16:59.031675Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-22T01:16:59.031677Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-22T01:16:59.031962Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-22T01:16:59.032011Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-22T01:16:59.031970Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:59.032058Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:59.032191Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:59.032271Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:59.032311Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-22T01:16:59.032357Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:16:59.032452Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-22T01:16:59.033632Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-22T01:16:59.034165Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:59.035161Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:59.047330Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:16:59.438458Z info ads Push debounce stable[871] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-e4b9ac: 100.217176ms since last change, 100.217116ms since last push, full=true 2026-07-22T01:16:59.450616Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-22T01:16:59Z/499 2026-07-22T01:16:59.450972Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:59.451037Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:59.450975Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:59.450976Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:59.451534Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:16:59.452845Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-22T01:16:59.457895Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:16:59.633823Z info ads Push debounce stable[872] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4f35c1: 100.219107ms since last change, 100.219044ms since last push, full=true 2026-07-22T01:16:59.644451Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-22T01:16:59Z/500 2026-07-22T01:16:59.644837Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:16:59.644847Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:16:59.644845Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:59.644844Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:16:59.645774Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:16:59.645807Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:16:59.651176Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:17:07.118722Z info ads Push debounce stable[873] 3 for config Secret/llm/deployer-dockercfg-l6zr4 and 2 more configs: 100.891645ms since last change, 104.208744ms since last push, full=false 2026-07-22T01:17:07.118780Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:16:59Z/500 2026-07-22T01:17:14.828144Z info ads Push debounce stable[874] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.845506ms since last change, 206.825267ms since last push, full=true 2026-07-22T01:17:14.829552Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-22T01:17:14Z/501 2026-07-22T01:17:14.830998Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:140 removed:0 size:160.7kB cached:135/137 2026-07-22T01:17:14.831303Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:138 removed:0 size:160.3kB cached:135/137 2026-07-22T01:17:14.831444Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:140 removed:0 size:160.7kB cached:135/137 2026-07-22T01:17:14.831748Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:140 removed:0 size:160.7kB cached:135/137 2026-07-22T01:17:14.831929Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-22T01:17:14.831929Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:135/137 2026-07-22T01:17:14.832211Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-22T01:17:14.832296Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-22T01:17:14.832429Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:14.832566Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:17:14.832470Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:14.832661Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:17:14.832481Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:14.832749Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-22T01:17:14.832883Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-22T01:17:14.833304Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:17:14.833376Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:17:14.833511Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:17:14.839941Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:17:17.024512Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-22T01:17:24.414816Z info model Incremental push, service maas-api-e2e-shared-a-e4b9ac.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-22T01:17:24.554729Z info ads Push debounce stable[875] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~e2e-shared-a-e4b9ac-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.485842ms since last change, 146.761437ms since last push, full=true 2026-07-22T01:17:24.555364Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-22T01:17:24Z/502 2026-07-22T01:17:24.555765Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:1 size:44B 2026-07-22T01:17:24.555863Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:17:24.555884Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:17:24.556055Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:17:24.556535Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-22T01:17:24.556621Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-22T01:17:24.556828Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-22T01:17:24.556863Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:24.556884Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-22T01:17:24.556912Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:24.556958Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:17:24.556992Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-22T01:17:24.557055Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:24.557088Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:17:24.557111Z warn constructed http route config for route https.443.default.e2e-shared-a-e4b9ac-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-22T01:17:24.557139Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-22T01:17:24.557172Z info delta SDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:17:24.557219Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-22T01:17:24.557303Z info delta SDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:17:24.557892Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:17:24.557922Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:17:27.024811Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-22T01:17:27.632762Z info ads Push debounce stable[876] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-shared-a-e4b9ac: 100.228651ms since last change, 100.228577ms since last push, full=true 2026-07-22T01:17:27.632977Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-22T01:17:27Z/503 2026-07-22T01:17:27.633906Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:139 removed:0 size:159.6kB cached:136/136 2026-07-22T01:17:27.633913Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:139 removed:0 size:159.6kB cached:136/136 2026-07-22T01:17:27.633968Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:137 removed:0 size:159.1kB cached:136/136 2026-07-22T01:17:27.634419Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:138 removed:1 size:159.4kB cached:129/136 2026-07-22T01:17:27.634885Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-22T01:17:27.634949Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-22T01:17:27.634969Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-22T01:17:27.635229Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:27.635270Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:27.635381Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:27.635412Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-22T01:17:27.635439Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:17:27.635510Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-22T01:17:27.635693Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:17:27.635750Z warn constructed http route config for route https.443.default.e2e-shared-a-e4b9ac-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-22T01:17:27.635785Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-22T01:17:27.636186Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:17:27.636264Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:17:27.636352Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:17:27.642681Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:17:28.045060Z info ads Push debounce stable[877] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-e4b9ac: 100.221867ms since last change, 100.221815ms since last push, full=true 2026-07-22T01:17:28.054936Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-22T01:17:28Z/504 2026-07-22T01:17:28.055270Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-22T01:17:28.055289Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:28.055310Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:0 removed:0 size:0B 2026-07-22T01:17:28.055275Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:28.055342Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:28.055898Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:17:28.062729Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:17:31.116475Z info ads Push debounce stable[878] 1 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-xrbcc: 100.220561ms since last change, 100.220491ms since last push, full=false 2026-07-22T01:17:31.116547Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:17:28Z/504 2026-07-22T01:17:34.575632Z info ads Push debounce stable[879] 3 for config Secret/ai-tenant-e2e-shared-a-e4b9ac/builder-dockercfg-m2kjk and 2 more configs: 100.192582ms since last change, 104.06955ms since last push, full=false 2026-07-22T01:17:34.575696Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:17:28Z/504 2026-07-22T01:17:35.310322Z info ads Push debounce stable[880] 1 for config ConfigMap/ai-tenant-e2e-shared-a-e4b9ac/kube-root-ca.crt: 100.321051ms since last change, 100.321ms since last push, full=false 2026-07-22T01:17:35.310384Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-22T01:17:28Z/504 2026-07-22T01:17:35.829978Z info ads Push debounce stable[881] 1 for config Gateway/openshift-ingress/e2e-shared-a-e4b9ac-istio-autogenerated-k8s-gateway-https: 100.221883ms since last change, 100.221833ms since last push, full=true 2026-07-22T01:17:35.830107Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-22T01:17:35Z/505 2026-07-22T01:17:35.830445Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:35.830456Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:35.830571Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:17:35.830456Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-22T01:17:35.830447Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:35.830650Z warn constructed http route config for route https.443.default.e2e-shared-a-e4b9ac-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-22T01:17:35.830679Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-22T01:17:35.830791Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-22T01:17:35.831464Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:17:36.007035Z info model Incremental push, service e2e-shared-a-e4b9ac-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-22T01:17:36.108010Z info ads Push debounce stable[882] 6 for config Gateway/openshift-ingress/e2e-shared-a-e4b9ac-istio-autogenerated-k8s-gateway-https and 4 more configs: 100.610396ms since last change, 124.318618ms since last push, full=true 2026-07-22T01:17:36.108733Z info ads XDS: Pushing Services:105 ConnectedEndpoints:4 Version:2026-07-22T01:17:36Z/506 2026-07-22T01:17:36.110178Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:137 removed:2 size:156.9kB cached:134/134 2026-07-22T01:17:36.110240Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:135 removed:3 size:156.5kB cached:134/134 2026-07-22T01:17:36.110243Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:135 removed:2 size:156.5kB cached:134/134 2026-07-22T01:17:36.110272Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:137 removed:2 size:156.9kB cached:134/134 2026-07-22T01:17:36.111020Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-22T01:17:36.111030Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-22T01:17:36.111461Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-22T01:17:36.111487Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:36.111508Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:36.111513Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:0 removed:1 size:0B 2026-07-22T01:17:36.111468Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-22T01:17:36.111528Z warn buildGatewayRoutes: no gateways for router e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress 2026-07-22T01:17:36.111553Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-22T01:17:36.111577Z warn ads proxy e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress attempted to access unauthorized certificates e2e-shared-a-e4b9ac-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-22T01:17:36.111629Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:0 removed:0 size:0B 2026-07-22T01:17:36.111653Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:17:36.111751Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:36.111789Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-22T01:17:36.111663Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-22T01:17:36.111886Z info delta SDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:17:36.112478Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:17:36.112645Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:17:36.112678Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:17:36.119436Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:17:37.024488Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-22T01:17:37.201298Z info ads Push debounce stable[883] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.38271ms since last change, 186.660915ms since last push, full=true 2026-07-22T01:17:37.202700Z info ads XDS: Pushing Services:105 ConnectedEndpoints:4 Version:2026-07-22T01:17:37Z/507 2026-07-22T01:17:37.203958Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:137 removed:0 size:156.9kB cached:132/134 2026-07-22T01:17:37.204175Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:135 removed:0 size:156.5kB cached:134/134 2026-07-22T01:17:37.204194Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:137 removed:0 size:156.9kB cached:132/134 2026-07-22T01:17:37.204208Z info delta CDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:135 removed:0 size:156.5kB cached:132/134 2026-07-22T01:17:37.204577Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:132/134 2026-07-22T01:17:37.204909Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:17:37.205099Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:134/134 2026-07-22T01:17:37.205244Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:134/134 2026-07-22T01:17:37.205271Z info delta EDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:134/134 2026-07-22T01:17:37.205317Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:37.205359Z info delta LDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:0 removed:0 size:0B 2026-07-22T01:17:37.205383Z warn buildGatewayRoutes: no gateways for router e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress 2026-07-22T01:17:37.205402Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:17:37.205407Z info delta RDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-22T01:17:37.205438Z info delta ECDS: PUSH for node:e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress resources:0 removed:0 size:0B 2026-07-22T01:17:37.205251Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-22T01:17:37.205538Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:37.206054Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:17:37.206737Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:17:37.213148Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:17:41.023416Z info delta ADS: "10.134.0.41:39178" e2e-shared-a-e4b9ac-openshift-default-599fd65b55-mh7rj.openshift-ingress-27 terminated 2026-07-22T01:17:46.815734Z info model Incremental push, service maas-api-e2e-shared-b-4f35c1.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-22T01:17:46.963829Z info ads Push debounce stable[884] 5 for config ServiceEntry/odh-ai-gateway-infra/maas-api-e2e-shared-b-4f35c1.odh-ai-gateway-infra.svc.cluster.local and 3 more configs: 100.297055ms since last change, 157.64439ms since last push, full=true 2026-07-22T01:17:46.964474Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-22T01:17:46Z/508 2026-07-22T01:17:46.965126Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:1 size:44B 2026-07-22T01:17:46.965177Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:17:46.965232Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:3 removed:1 size:507B 2026-07-22T01:17:46.965992Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:134 removed:0 size:32.2kB empty:1 cached:133/134 2026-07-22T01:17:46.966069Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:134 removed:0 size:32.2kB empty:1 cached:133/134 2026-07-22T01:17:46.966091Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:134 removed:0 size:32.2kB empty:1 cached:133/134 2026-07-22T01:17:46.966337Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:46.966390Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:46.966493Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:17:46.966514Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:17:46.966553Z warn constructed http route config for route https.443.default.e2e-shared-b-4f35c1-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-22T01:17:46.966567Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-22T01:17:46.966582Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-22T01:17:46.966639Z info delta SDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:17:46.967310Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:17:46.967340Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:17:47.024919Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-22T01:17:49.835384Z info ads Push debounce stable[885] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-shared-b-4f35c1: 100.365342ms since last change, 100.365261ms since last push, full=true 2026-07-22T01:17:49.835572Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-22T01:17:49Z/509 2026-07-22T01:17:49.836391Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:134 removed:0 size:155.3kB cached:133/133 2026-07-22T01:17:49.836418Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:136 removed:0 size:155.8kB cached:133/133 2026-07-22T01:17:49.836758Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:135 removed:1 size:155.6kB cached:129/133 2026-07-22T01:17:49.837058Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-22T01:17:49.837362Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:49.837473Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:17:49.837496Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-22T01:17:49.837578Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-22T01:17:49.837791Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:49.837813Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-22T01:17:49.837841Z warn constructed http route config for route https.443.default.e2e-shared-b-4f35c1-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-22T01:17:49.837873Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-22T01:17:49.838402Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-22T01:17:49.838672Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:17:49.845181Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:17:50.430258Z info ads Push debounce stable[886] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4f35c1: 100.220388ms since last change, 100.220324ms since last push, full=true 2026-07-22T01:17:50.439732Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-22T01:17:50Z/510 2026-07-22T01:17:50.440077Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:50.440094Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:50.440138Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-22T01:17:50.440183Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:0 removed:0 size:0B 2026-07-22T01:17:50.446982Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:17:57.061632Z info ads Push debounce stable[887] 3 for config Secret/ai-tenant-e2e-shared-b-4f35c1/builder-dockercfg-tzcbx and 2 more configs: 100.503082ms since last change, 105.133738ms since last push, full=false 2026-07-22T01:17:57.061684Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-22T01:17:50Z/510 2026-07-22T01:17:57.327657Z info ads Push debounce stable[888] 1 for config ConfigMap/ai-tenant-e2e-shared-b-4f35c1/kube-root-ca.crt: 100.116365ms since last change, 100.116273ms since last push, full=false 2026-07-22T01:17:57.327734Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-22T01:17:50Z/510 2026-07-22T01:17:57.846663Z info ads Push debounce stable[889] 1 for config Gateway/openshift-ingress/e2e-shared-b-4f35c1-istio-autogenerated-k8s-gateway-https: 100.214926ms since last change, 100.214833ms since last push, full=true 2026-07-22T01:17:57.846791Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-22T01:17:57Z/511 2026-07-22T01:17:57.847127Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:57.847222Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:17:57.847233Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:57.847133Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-22T01:17:57.847375Z warn constructed http route config for route https.443.default.e2e-shared-b-4f35c1-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-22T01:17:57.847409Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-22T01:17:57.848257Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:17:58.021588Z info model Incremental push, service e2e-shared-b-4f35c1-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-22T01:17:58.122469Z info ads Push debounce stable[890] 6 for config Secret/openshift-ingress/e2e-shared-b-4f35c1-openshift-default-dockercfg-prr8k and 4 more configs: 100.811786ms since last change, 124.075058ms since last push, full=true 2026-07-22T01:17:58.123171Z info ads XDS: Pushing Services:103 ConnectedEndpoints:3 Version:2026-07-22T01:17:58Z/512 2026-07-22T01:17:58.124304Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:134 removed:2 size:153.1kB cached:131/131 2026-07-22T01:17:58.124310Z info delta CDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:132 removed:3 size:152.7kB cached:131/131 2026-07-22T01:17:58.124349Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:132 removed:2 size:152.7kB cached:131/131 2026-07-22T01:17:58.125052Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-22T01:17:58.125234Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-22T01:17:58.125438Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-22T01:17:58.125459Z info delta EDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-22T01:17:58.125505Z info delta LDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:0 removed:1 size:0B 2026-07-22T01:17:58.125524Z warn buildGatewayRoutes: no gateways for router e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress 2026-07-22T01:17:58.125542Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-22T01:17:58.125553Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-22T01:17:58.125582Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf4hgmfl.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-22T01:17:58.125546Z info delta RDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-22T01:17:58.125638Z warn ads proxy e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress attempted to access unauthorized certificates e2e-shared-b-4f35c1-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-22T01:17:58.125677Z info delta ECDS: PUSH for node:e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress resources:0 removed:0 size:0B 2026-07-22T01:17:58.126483Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:51.8kB cached:0/0 2026-07-22T01:17:58.126525Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-22T01:17:58.132901Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-22T01:18:03.040172Z info delta ADS: "10.134.0.42:36760" e2e-shared-b-4f35c1-openshift-default-5f5d49b879-nm5lb.openshift-ingress-28 terminated 2026-07-22T01:18:07.024115Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-pqbfw.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } }