2026-07-13T20:13:54.511494Z info delta SDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:13:54.511825Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:13:54.511876Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:13:54.518620Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-13T20:13:54.714846Z info ads Push debounce stable[428] 7 for config Secret/e2e-mt-other-f915346b/deployer-dockercfg-69c8f and 3 more configs: 100.510336ms since last change, 165.711927ms since last push, full=false 2026-07-13T20:13:54.714930Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:13:54Z/200 2026-07-13T20:13:55.110974Z info ads Push debounce stable[429] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-mt-f915346b: 100.751109ms since last change, 100.751055ms since last push, full=true 2026-07-13T20:13:55.120899Z info ads XDS: Pushing Services:105 ConnectedEndpoints:3 Version:2026-07-13T20:13:55Z/201 2026-07-13T20:13:55.121229Z info delta LDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-13T20:13:55.121229Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:13:55.121232Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:13:55.128405Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-13T20:13:55.129180Z info delta ECDS: PUSH request for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:7.2kB filtered:0 2026-07-13T20:13:58.736998Z info ads Push debounce stable[430] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-e2e-mt-f915346b.odh-ai-gateway-infra.svc.cluster.local: 100.045034ms since last change, 100.044964ms since last push, full=false 2026-07-13T20:13:58.737079Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:13:55Z/201 2026-07-13T20:14:00.453136Z info ads Push debounce stable[431] 3 for config Secret/e2e-mt-other-f915346b/builder-dockercfg-dnk92 and 2 more configs: 100.809153ms since last change, 105.881293ms since last push, full=false 2026-07-13T20:14:00.453197Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:13:55Z/201 2026-07-13T20:14:00.818179Z info ads Push debounce stable[432] 1 for config ConfigMap/e2e-mt-other-f915346b/kube-root-ca.crt: 100.252991ms since last change, 100.252913ms since last push, full=false 2026-07-13T20:14:00.818299Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:13:55Z/201 2026-07-13T20:14:01.409299Z info ads Push debounce stable[433] 1 for config Secret/ai-tenant-e2e-mt-f915346b/e2e-mt-rbac-f915346b-dockercfg-lnsz7: 100.66709ms since last change, 100.667026ms since last push, full=false 2026-07-13T20:14:01.409366Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:13:55Z/201 2026-07-13T20:14:01.471954Z info model Incremental push, service maas-api-e2e-mt-f915346b.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-13T20:14:01.587608Z info ads Push debounce stable[434] 4 for config ServiceEntry/odh-ai-gateway-infra/maas-api-e2e-mt-f915346b.odh-ai-gateway-infra.svc.cluster.local and 2 more configs: 100.205516ms since last change, 131.659052ms since last push, full=true 2026-07-13T20:14:01.588387Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-13T20:14:01Z/202 2026-07-13T20:14:01.588945Z info delta CDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:3 removed:1 size:507B 2026-07-13T20:14:01.589010Z info delta EDS: PUSH INC for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-13T20:14:01.589024Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:3 removed:1 size:507B 2026-07-13T20:14:01.589081Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-13T20:14:01.588946Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:1 size:44B 2026-07-13T20:14:01.589229Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-13T20:14:01.589310Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:14:01.589322Z info delta LDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-13T20:14:01.589348Z warn constructed http route config for route https.443.default.e2e-mt-f915346b-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:14:01.589377Z info delta RDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:121B cached:0/0 2026-07-13T20:14:01.589420Z info delta SDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:14:01.589454Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:14:01.589548Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:14:01.589599Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-13T20:14:01.590445Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:14:01.590483Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:14:02.496540Z info delta ADS: "10.134.0.43:39078" e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress-7 terminated 2026-07-13T20:14:03.414331Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-mt-f915346b 2026-07-13T20:14:03.414371Z info gateway reconciling gateway=openshift-ingress/e2e-mt-f915346b 2026-07-13T20:14:03.456918Z info gateway gateway updated gateway=openshift-ingress/e2e-mt-f915346b 2026-07-13T20:14:03.501494Z info ads Push debounce stable[435] 1 for config ServiceEntry/openshift-ingress/e2e-mt-f915346b-openshift-default.openshift-ingress.svc.cluster.local: 100.520004ms since last change, 100.519923ms since last push, full=false 2026-07-13T20:14:03.501550Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-13T20:14:01Z/202 2026-07-13T20:14:03.541580Z info delta ADS: new delta connection for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress-8 2026-07-13T20:14:03.542393Z info delta CDS: PUSH request for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:136 removed:0 size:155.7kB cached:131/133 2026-07-13T20:14:03.626156Z info delta EDS: PUSH request for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:133 removed:0 size:31.7kB empty:0 cached:133/133 filtered:0 2026-07-13T20:14:03.685402Z info delta LDS: PUSH request for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-13T20:14:03.692792Z info delta ECDS: PUSH request for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:7.2kB filtered:0 2026-07-13T20:14:03.693044Z warn constructed http route config for route https.443.default.e2e-mt-f915346b-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:14:03.693097Z info delta RDS: PUSH request for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:121B cached:0/0 filtered:0 2026-07-13T20:14:03.693790Z info delta SDS: PUSH request for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-07-13T20:14:03.797279Z info ads Push debounce stable[436] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-mt-f915346b: 100.664213ms since last change, 100.664096ms since last push, full=true 2026-07-13T20:14:03.797452Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-13T20:14:03Z/203 2026-07-13T20:14:03.798447Z info delta CDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:135 removed:1 size:155.6kB cached:131/133 2026-07-13T20:14:03.798721Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:136 removed:0 size:155.7kB cached:131/133 2026-07-13T20:14:03.798821Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:134 removed:0 size:155.3kB cached:131/133 2026-07-13T20:14:03.798997Z info delta EDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:133 removed:0 size:31.7kB empty:0 cached:133/133 2026-07-13T20:14:03.799314Z info delta LDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-13T20:14:03.799342Z warn constructed http route config for route https.443.default.e2e-mt-f915346b-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:14:03.799369Z info delta RDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:121B cached:0/0 2026-07-13T20:14:03.799468Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:133 removed:0 size:31.7kB empty:0 cached:133/133 2026-07-13T20:14:03.799687Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:133 removed:0 size:31.7kB empty:0 cached:133/133 2026-07-13T20:14:03.799804Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:14:03.799902Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:14:03.799962Z info delta ECDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:14:03.799995Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:14:03.800788Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:14:03.807336Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-13T20:14:04.295799Z info ads Push debounce stable[437] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-mt-f915346b: 100.669518ms since last change, 100.669455ms since last push, full=true 2026-07-13T20:14:04.305168Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-13T20:14:04Z/204 2026-07-13T20:14:04.305539Z info delta LDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:14:04.305579Z info delta ECDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:0 removed:0 size:0B 2026-07-13T20:14:04.305539Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:14:04.305539Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:14:04.311873Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-13T20:14:07.710790Z info ads Push debounce stable[438] 3 for config Secret/ai-tenant-e2e-mt-f915346b/deployer-dockercfg-4rmwc and 2 more configs: 100.223564ms since last change, 108.722246ms since last push, full=false 2026-07-13T20:14:07.710868Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:04Z/204 2026-07-13T20:14:08.008510Z info ads Push debounce stable[439] 1 for config ConfigMap/ai-tenant-e2e-mt-f915346b/kube-root-ca.crt: 100.293249ms since last change, 100.29319ms since last push, full=false 2026-07-13T20:14:08.008571Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:04Z/204 2026-07-13T20:14:08.511908Z info delta CDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:135 removed:0 size:155.6kB cached:133/133 2026-07-13T20:14:08.512538Z info delta EDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:133 removed:0 size:31.7kB empty:0 cached:133/133 2026-07-13T20:14:08.512839Z info delta LDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:14:08.512872Z warn constructed http route config for route https.443.default.e2e-mt-f915346b-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:14:08.512903Z info delta RDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:121B cached:0/0 2026-07-13T20:14:08.512943Z info delta SDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:14:08.512973Z info delta ECDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:0 removed:0 size:0B 2026-07-13T20:14:08.541566Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-mt-f915346b 2026-07-13T20:14:08.541603Z info gateway reconciling gateway=openshift-ingress/e2e-mt-f915346b 2026-07-13T20:14:08.593609Z info gateway gateway updated gateway=openshift-ingress/e2e-mt-f915346b 2026-07-13T20:14:08.629597Z info ads Push debounce stable[440] 1 for config ServiceEntry/openshift-ingress/e2e-mt-f915346b-openshift-default.openshift-ingress.svc.cluster.local: 100.931338ms since last change, 100.931269ms since last push, full=false 2026-07-13T20:14:08.629656Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:04Z/204 2026-07-13T20:14:09.206015Z info ads Push debounce stable[441] 1 for config Gateway/openshift-ingress/e2e-mt-f915346b-istio-autogenerated-k8s-gateway-https: 100.465017ms since last change, 100.464933ms since last push, full=true 2026-07-13T20:14:09.206180Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-13T20:14:09Z/205 2026-07-13T20:14:09.206547Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:14:09.206594Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:14:09.206550Z info delta LDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:14:09.206706Z warn constructed http route config for route https.443.default.e2e-mt-f915346b-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:14:09.206743Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:14:09.206760Z info delta RDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:121B cached:0/0 2026-07-13T20:14:09.207562Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:14:09.410146Z info model Incremental push, service e2e-mt-f915346b-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-13T20:14:09.517779Z info ads Push debounce stable[442] 6 for config ServiceEntry/openshift-ingress/e2e-mt-f915346b-openshift-default.openshift-ingress.svc.cluster.local and 4 more configs: 100.624675ms since last change, 163.123855ms since last push, full=true 2026-07-13T20:14:09.518448Z info ads XDS: Pushing Services:103 ConnectedEndpoints:3 Version:2026-07-13T20:14:09Z/206 2026-07-13T20:14:09.519578Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:132 removed:2 size:152.7kB cached:131/131 2026-07-13T20:14:09.519646Z info delta CDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:132 removed:3 size:152.7kB cached:131/131 2026-07-13T20:14:09.519975Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:134 removed:2 size:153.1kB cached:131/131 2026-07-13T20:14:09.520309Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-13T20:14:09.520584Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:14:09.520699Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:14:09.520736Z info delta EDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-13T20:14:09.520741Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-13T20:14:09.520787Z info delta LDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:0 removed:1 size:0B 2026-07-13T20:14:09.520835Z warn buildGatewayRoutes: no gateways for router e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress 2026-07-13T20:14:09.520869Z info delta RDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:1 removed:0 size:93B cached:0/0 2026-07-13T20:14:09.520890Z warn ads proxy e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress attempted to access unauthorized certificates e2e-mt-f915346b-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:14:09.520927Z info delta ECDS: PUSH for node:e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress resources:0 removed:0 size:0B 2026-07-13T20:14:09.520950Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-13T20:14:09.521208Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:14:09.522038Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:14:09.522070Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:14:09.528506Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-13T20:14:09.865533Z info ads Push debounce stable[443] 7 for config ConfigMap/e2e-webhook-sub-d674a44f/kube-root-ca.crt and 3 more configs: 100.236254ms since last change, 145.704719ms since last push, full=false 2026-07-13T20:14:09.865604Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:09Z/206 2026-07-13T20:14:09.865743Z warn ads proxy e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress attempted to access unauthorized certificates e2e-mt-f915346b-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:14:15.099424Z info ads Push debounce stable[444] 3 for config Secret/e2e-webhook-sub-d674a44f/builder-dockercfg-5nhh8 and 2 more configs: 100.279781ms since last change, 106.0864ms since last push, full=false 2026-07-13T20:14:15.099494Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:09Z/206 2026-07-13T20:14:15.099569Z warn ads proxy e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress attempted to access unauthorized certificates e2e-mt-f915346b-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:14:15.651967Z info ads Push debounce stable[445] 1 for config ConfigMap/e2e-webhook-sub-d674a44f/kube-root-ca.crt: 100.595951ms since last change, 100.595886ms since last push, full=false 2026-07-13T20:14:15.652024Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:09Z/206 2026-07-13T20:14:15.652162Z warn ads proxy e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress attempted to access unauthorized certificates e2e-mt-f915346b-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:14:16.052787Z info ads Push debounce stable[446] 7 for config Secret/e2e-webhook-auth-c36dcf9a/deployer-dockercfg-rqscb and 3 more configs: 101.015415ms since last change, 151.783136ms since last push, full=false 2026-07-13T20:14:16.052861Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:09Z/206 2026-07-13T20:14:16.053005Z warn ads proxy e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress attempted to access unauthorized certificates e2e-mt-f915346b-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:14:16.431406Z info delta ADS: "10.134.0.43:58184" e2e-mt-f915346b-openshift-default-8489c49ccf-qg7xp.openshift-ingress-8 terminated 2026-07-13T20:14:19.254772Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-13T20:14:21.462960Z info ads Push debounce stable[447] 1 for config ConfigMap/e2e-webhook-auth-c36dcf9a/kube-root-ca.crt: 100.281638ms since last change, 100.281562ms since last push, full=false 2026-07-13T20:14:21.463037Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-13T20:14:09Z/206 2026-07-13T20:14:21.622021Z info ads Push debounce stable[448] 3 for config Secret/e2e-webhook-auth-c36dcf9a/builder-dockercfg-knrcf and 2 more configs: 100.209959ms since last change, 106.617251ms since last push, full=false 2026-07-13T20:14:21.622085Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-13T20:14:09Z/206 2026-07-13T20:14:29.131125Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.147931Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.147958Z info gateway reconciling gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.266774Z info gateway gateway updated gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.266812Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.266825Z info gateway reconciling gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.289401Z info model Incremental push, service e2e-mt-62c05fae-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-13T20:14:29.389877Z info ads Push debounce stable[449] 6 for config Gateway/openshift-ingress/e2e-mt-62c05fae-istio-autogenerated-k8s-gateway-https and 3 more configs: 100.41514ms since last change, 241.703616ms since last push, full=true 2026-07-13T20:14:29.391207Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-07-13T20:14:29Z/207 2026-07-13T20:14:29.392325Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:134 removed:0 size:155.2kB cached:131/133 2026-07-13T20:14:29.392398Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:136 removed:0 size:155.6kB cached:131/133 2026-07-13T20:14:29.392971Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:131 removed:0 size:31.5kB empty:0 cached:131/131 2026-07-13T20:14:29.393236Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:14:29.393349Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:14:29.393392Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-13T20:14:29.393443Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:131 removed:0 size:31.5kB empty:0 cached:131/131 2026-07-13T20:14:29.393741Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:14:29.394659Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:14:29.394699Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:14:29.401120Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-13T20:14:29.407857Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:2 removed:0 size:172B empty:2 cached:0/2 filtered:131 2026-07-13T20:14:29.408180Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:2 removed:0 size:172B empty:0 cached:2/2 filtered:131 2026-07-13T20:14:29.511323Z info ads Push debounce stable[450] 2 for config Secret/openshift-ingress/e2e-mt-62c05fae-gw-service-tls and 1 more configs: 100.521681ms since last change, 101.105547ms since last push, full=true 2026-07-13T20:14:29.511450Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-07-13T20:14:29Z/208 2026-07-13T20:14:29.511793Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:14:29.511893Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:14:29.511925Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-13T20:14:29.511795Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:14:29.513001Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:14:29.513040Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:14:29.595393Z error controllers error handling openshift-ingress/e2e-mt-62c05fae, retrying (retry count: 1): apply failed: patch apps/v1, Kind=Deployment/openshift-ingress/e2e-mt-62c05fae-openshift-default: Operation cannot be fulfilled on deployments.apps "e2e-mt-62c05fae-openshift-default": the object has been modified; please apply your changes to the latest version and try again controller=gateway deployment 2026-07-13T20:14:29.595439Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.595455Z info gateway reconciling gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.700303Z info gateway gateway updated gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.700343Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.700357Z info gateway reconciling gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.771660Z info gateway gateway updated gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:29.986547Z info delta ADS: new delta connection for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress-9 2026-07-13T20:14:29.995613Z info delta CDS: PUSH request for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:135 removed:0 size:155.5kB cached:0/133 2026-07-13T20:14:30.073034Z info delta EDS: PUSH request for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:133 removed:0 size:31.7kB empty:0 cached:133/133 filtered:0 2026-07-13T20:14:30.125528Z info delta LDS: PUSH request for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:14:30.131109Z warn constructed http route config for route https.443.default.e2e-mt-62c05fae-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:14:30.131167Z info delta RDS: PUSH request for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:121B cached:0/0 filtered:0 2026-07-13T20:14:30.131668Z info delta SDS: PUSH request for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:4.5kB cached:0/1 filtered:0 2026-07-13T20:14:30.551562Z info model Full push, new service openshift-ingress/e2e-mt-62c05fae-openshift-default.openshift-ingress.svc.cluster.local 2026-07-13T20:14:30.651839Z info ads Push debounce stable[451] 1 for config ServiceEntry/openshift-ingress/e2e-mt-62c05fae-openshift-default.openshift-ingress.svc.cluster.local: 100.226715ms since last change, 100.226598ms since last push, full=true 2026-07-13T20:14:30.652454Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-13T20:14:30Z/209 2026-07-13T20:14:30.653103Z info delta CDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:4 removed:0 size:3.0kB cached:0/2 2026-07-13T20:14:30.653178Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:3 removed:0 size:2.6kB cached:0/2 2026-07-13T20:14:30.653224Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:5 removed:0 size:3.1kB cached:0/2 2026-07-13T20:14:30.653183Z info delta EDS: PUSH INC for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:2 removed:0 size:172B empty:2 cached:0/2 2026-07-13T20:14:30.653285Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:2 removed:0 size:172B empty:0 cached:2/2 2026-07-13T20:14:30.653328Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:2 removed:0 size:172B empty:0 cached:2/2 2026-07-13T20:14:30.653506Z info delta LDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:14:30.653528Z warn constructed http route config for route https.443.default.e2e-mt-62c05fae-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:14:30.653542Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:14:30.653552Z info delta RDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:121B cached:0/0 2026-07-13T20:14:30.653637Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:14:30.653758Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:14:30.654597Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:14:31.556156Z info delta CDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:135 removed:0 size:155.6kB cached:2/133 2026-07-13T20:14:31.556805Z info delta EDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:133 removed:0 size:31.7kB empty:0 cached:133/133 2026-07-13T20:14:31.557072Z info delta LDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:14:31.557100Z warn constructed http route config for route https.443.default.e2e-mt-62c05fae-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:14:31.557124Z info delta RDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:121B cached:0/0 2026-07-13T20:14:31.557219Z info delta SDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:4.5kB cached:0/1 2026-07-13T20:14:31.573545Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:31.573578Z info gateway reconciling gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:31.608730Z info gateway gateway updated gateway=openshift-ingress/e2e-mt-62c05fae 2026-07-13T20:14:31.659740Z info ads Push debounce stable[452] 1 for config ServiceEntry/openshift-ingress/e2e-mt-62c05fae-openshift-default.openshift-ingress.svc.cluster.local: 100.790794ms since last change, 100.790741ms since last push, full=false 2026-07-13T20:14:31.659794Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:30Z/209 2026-07-13T20:14:32.528828Z info ads Push debounce stable[453] 7 for config Secret/ai-tenant-e2e-mt-62c05fae/deployer-dockercfg-nvzds and 3 more configs: 100.185551ms since last change, 135.475615ms since last push, full=false 2026-07-13T20:14:32.528919Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:30Z/209 2026-07-13T20:14:37.015815Z info ads Push debounce stable[454] 1 for config Gateway/openshift-ingress/e2e-mt-62c05fae-istio-autogenerated-k8s-gateway-https: 100.230762ms since last change, 100.230699ms since last push, full=true 2026-07-13T20:14:37.015952Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-13T20:14:37Z/210 2026-07-13T20:14:37.016329Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:14:37.016335Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:14:37.016371Z info delta LDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:14:37.016406Z warn constructed http route config for route https.443.default.e2e-mt-62c05fae-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:14:37.016434Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:14:37.016447Z info delta RDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:121B cached:0/0 2026-07-13T20:14:37.017365Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:15:52.184541Z info delta ADS: "10.134.0.28:49234" data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress-1 terminated 2026-07-13T20:15:52.622273Z info delta ADS: new delta connection for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress-10 2026-07-13T20:15:52.623345Z info delta CDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:134 removed:0 size:155.3kB cached:131/133 filtered:0 2026-07-13T20:15:52.624023Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:133 removed:0 size:32.0kB empty:0 cached:133/133 filtered:0 2026-07-13T20:15:52.624359Z info delta LDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB filtered:0 2026-07-13T20:15:52.624432Z info delta SDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 filtered:0 2026-07-13T20:15:52.624669Z info delta RDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 filtered:0 2026-07-13T20:16:59.131364Z info ads Push debounce stable[455] 7 for config Secret/openshift-kube-storage-version-migrator/builder-dockercfg-bt9x5 and 6 more configs: 101.004286ms since last change, 116.382534ms since last push, full=false 2026-07-13T20:16:59.131480Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:37Z/210 2026-07-13T20:17:00.115905Z info ads Push debounce stable[456] 1 for config Secret/openshift-service-ca/service-ca-dockercfg-8qgfh: 100.230496ms since last change, 100.230431ms since last push, full=false 2026-07-13T20:17:00.115962Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:37Z/210 2026-07-13T20:17:07.115878Z info ads Push debounce stable[457] 1 for config Secret/openshift-infra/node-bootstrapper-dockercfg-clr82: 100.967062ms since last change, 100.96701ms since last push, full=false 2026-07-13T20:17:07.115957Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:37Z/210 2026-07-13T20:17:26.116452Z info ads Push debounce stable[458] 2 for config Secret/openshift-monitoring/prometheus-operator-dockercfg-dxxwm and 1 more configs: 100.311401ms since last change, 100.315418ms since last push, full=false 2026-07-13T20:17:26.116514Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:37Z/210 2026-07-13T20:17:37.115577Z info ads Push debounce stable[459] 1 for config Secret/open-cluster-management-agent-addon/klusterlet-addon-workmgr-log-dockercfg-dhx28: 100.628751ms since last change, 100.628698ms since last push, full=false 2026-07-13T20:17:37.115632Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:37Z/210 2026-07-13T20:17:47.407001Z info ads Push debounce stable[460] 4 for config Secret/ai-tenant-e2e-mt-62c05fae/deployer-dockercfg-nvzds and 3 more configs: 101.074247ms since last change, 133.052861ms since last push, full=false 2026-07-13T20:17:47.407073Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:14:37Z/210 2026-07-13T20:17:47.955006Z info ads Push debounce stable[461] 1 for config Gateway/openshift-ingress/e2e-mt-62c05fae-istio-autogenerated-k8s-gateway-https: 100.238521ms since last change, 100.238449ms since last push, full=true 2026-07-13T20:17:47.955150Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-13T20:17:47Z/211 2026-07-13T20:17:47.955524Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:17:47.955527Z info delta LDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:17:47.955560Z warn constructed http route config for route https.443.default.e2e-mt-62c05fae-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:17:47.955586Z info delta RDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:121B cached:0/0 2026-07-13T20:17:47.955686Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:17:47.955790Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:17:47.956503Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:17:48.131079Z info model Incremental push, service e2e-mt-62c05fae-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-13T20:17:48.233492Z info ads Push debounce stable[462] 11 for config Secret/openshift-monitoring/node-exporter-dockercfg-vzrmk and 9 more configs: 100.537997ms since last change, 217.911281ms since last push, full=true 2026-07-13T20:17:48.234162Z info ads XDS: Pushing Services:103 ConnectedEndpoints:3 Version:2026-07-13T20:17:48Z/212 2026-07-13T20:17:48.235189Z info delta CDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:132 removed:3 size:152.7kB cached:131/131 2026-07-13T20:17:48.235334Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:132 removed:2 size:152.7kB cached:131/131 2026-07-13T20:17:48.235425Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:134 removed:2 size:153.1kB cached:131/131 2026-07-13T20:17:48.235974Z info delta EDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-13T20:17:48.236020Z info delta LDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:0 removed:1 size:0B 2026-07-13T20:17:48.236032Z warn buildGatewayRoutes: no gateways for router e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress 2026-07-13T20:17:48.236049Z info delta RDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:1 removed:0 size:93B cached:0/0 2026-07-13T20:17:48.236064Z warn ads proxy e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress attempted to access unauthorized certificates e2e-mt-62c05fae-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:17:48.236179Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-13T20:17:48.236239Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-13T20:17:48.236628Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:17:48.236631Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:17:48.236866Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:17:48.236905Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-13T20:17:48.237644Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:17:48.237695Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:17:48.244525Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-13T20:17:49.137141Z info ads Push debounce stable[463] 2 for config Secret/openshift-monitoring/thanos-querier-dockercfg-mcd24 and 1 more configs: 100.559651ms since last change, 103.263888ms since last push, full=false 2026-07-13T20:17:49.137194Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:17:48Z/212 2026-07-13T20:17:49.137295Z warn ads proxy e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress attempted to access unauthorized certificates e2e-mt-62c05fae-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:17:49.254585Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-13T20:17:49.647724Z info ads Push debounce stable[464] 7 for config ConfigMap/ai-tenant-e2e-mt-39057eed/kube-root-ca.crt and 3 more configs: 100.630177ms since last change, 160.5728ms since last push, full=false 2026-07-13T20:17:49.647783Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:17:48Z/212 2026-07-13T20:17:49.647876Z warn ads proxy e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress attempted to access unauthorized certificates e2e-mt-62c05fae-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:17:50.124870Z info ads Push debounce stable[465] 1 for config Secret/openshift-monitoring/prometheus-k8s-dockercfg-tl9d7: 101.005346ms since last change, 101.005302ms since last push, full=false 2026-07-13T20:17:50.124945Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:17:48Z/212 2026-07-13T20:17:50.125028Z warn ads proxy e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress attempted to access unauthorized certificates e2e-mt-62c05fae-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:17:50.528998Z info ads Push debounce stable[466] 7 for config Secret/ai-tenant-e2e-mt-ea2ff266/default-dockercfg-2nmb2 and 3 more configs: 100.647605ms since last change, 146.950001ms since last push, full=false 2026-07-13T20:17:50.529079Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:17:48Z/212 2026-07-13T20:17:50.529229Z warn ads proxy e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress attempted to access unauthorized certificates e2e-mt-62c05fae-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:17:53.116318Z info ads Push debounce stable[467] 2 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway and 1 more configs: 100.559781ms since last change, 148.878829ms since last push, full=true 2026-07-13T20:17:53.127202Z info ads XDS: Pushing Services:103 ConnectedEndpoints:3 Version:2026-07-13T20:17:53Z/213 2026-07-13T20:17:53.127384Z info delta LDS: PUSH for node:e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress resources:0 removed:0 size:0B 2026-07-13T20:17:53.127425Z warn ads proxy e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress attempted to access unauthorized certificates e2e-mt-62c05fae-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:17:53.127627Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:17:53.127681Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:17:53.127627Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:17:53.127822Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-13T20:17:53.135778Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:151.4kB 2026-07-13T20:17:53.154001Z info delta ADS: "10.134.0.44:49796" e2e-mt-62c05fae-openshift-default-755655b9b7-msnwl.openshift-ingress-9 terminated 2026-07-13T20:17:57.460342Z info ads Push debounce stable[468] 3 for config Secret/ai-tenant-e2e-mt-39057eed/deployer-dockercfg-cbvx5 and 2 more configs: 100.257151ms since last change, 108.927325ms since last push, full=false 2026-07-13T20:17:57.460419Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-13T20:17:53Z/213 2026-07-13T20:17:57.896038Z info ads Push debounce stable[469] 1 for config ConfigMap/ai-tenant-e2e-mt-39057eed/kube-root-ca.crt: 100.244469ms since last change, 100.244403ms since last push, full=false 2026-07-13T20:17:57.896101Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-13T20:17:53Z/213 2026-07-13T20:18:01.670752Z info ads Push debounce stable[470] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.113075ms since last change, 100.112985ms since last push, full=true 2026-07-13T20:18:01.680197Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-07-13T20:18:01Z/214 2026-07-13T20:18:01.680611Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:18:01.680612Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:18:01.687216Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-13T20:18:03.951685Z info ads Push debounce stable[471] 4 for config ConfigMap/ai-tenant-e2e-mt-ea2ff266/kube-root-ca.crt and 3 more configs: 100.234771ms since last change, 146.125184ms since last push, full=false 2026-07-13T20:18:03.951751Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-13T20:18:01Z/214 2026-07-13T20:18:04.857184Z info ads Push debounce stable[472] 7 for config ConfigMap/ai-tenant-e2e-mt-8251a465/kube-root-ca.crt and 3 more configs: 100.985193ms since last change, 144.989498ms since last push, full=false 2026-07-13T20:18:04.857277Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-13T20:18:01Z/214 2026-07-13T20:18:41.775946Z info ads Push debounce stable[473] 3 for config Secret/ai-tenant-e2e-mt-8251a465/builder-dockercfg-969x9 and 2 more configs: 100.515795ms since last change, 104.298654ms since last push, full=false 2026-07-13T20:18:41.776027Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-13T20:18:01Z/214 2026-07-13T20:18:42.161176Z info ads Push debounce stable[474] 1 for config ConfigMap/ai-tenant-e2e-mt-8251a465/kube-root-ca.crt: 100.089984ms since last change, 100.089916ms since last push, full=false 2026-07-13T20:18:42.161284Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-13T20:18:01Z/214 2026-07-13T20:18:42.873526Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:42.881990Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:42.882022Z info gateway reconciling gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.007037Z info gateway gateway updated gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.007089Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.007104Z info gateway reconciling gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.017400Z info model Incremental push, service e2e-inf-a-917d1b-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-13T20:18:43.093918Z info gateway gateway updated gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.093957Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.093972Z info gateway reconciling gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.118161Z info ads Push debounce stable[475] 6 for config Gateway/openshift-ingress/e2e-inf-a-917d1b-istio-autogenerated-k8s-gateway-https and 3 more configs: 100.644507ms since last change, 235.924556ms since last push, full=true 2026-07-13T20:18:43.119441Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-07-13T20:18:43Z/215 2026-07-13T20:18:43.120824Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:134 removed:0 size:155.2kB cached:131/133 2026-07-13T20:18:43.120891Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:136 removed:0 size:155.6kB cached:131/133 2026-07-13T20:18:43.121540Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:131 removed:0 size:31.5kB empty:0 cached:131/131 2026-07-13T20:18:43.121561Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:131 removed:0 size:31.5kB empty:0 cached:131/131 2026-07-13T20:18:43.121814Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:18:43.121821Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:18:43.122008Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:18:43.122037Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-13T20:18:43.123175Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:18:43.123232Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:18:43.130100Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-13T20:18:43.140689Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:2 removed:0 size:174B empty:2 cached:0/2 filtered:131 2026-07-13T20:18:43.141147Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:2 removed:0 size:174B empty:0 cached:2/2 filtered:131 2026-07-13T20:18:43.152847Z info gateway gateway updated gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.152878Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.152889Z info gateway reconciling gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.193929Z info gateway gateway updated gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.193959Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.193970Z info gateway reconciling gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.234817Z info gateway gateway updated gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:43.272776Z info ads Push debounce stable[476] 2 for config Secret/openshift-ingress/e2e-inf-a-917d1b-gw-service-tls and 1 more configs: 100.532083ms since last change, 100.996698ms since last push, full=true 2026-07-13T20:18:43.272913Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-07-13T20:18:43Z/216 2026-07-13T20:18:43.273345Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:18:43.273486Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:18:43.273345Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:18:43.273528Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-13T20:18:43.274492Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:18:43.274533Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:18:43.661897Z info delta ADS: new delta connection for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress-11 2026-07-13T20:18:43.665569Z info delta CDS: PUSH request for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:135 removed:0 size:155.5kB cached:0/133 2026-07-13T20:18:43.741163Z info delta EDS: PUSH request for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:133 removed:0 size:31.7kB empty:0 cached:133/133 filtered:0 2026-07-13T20:18:43.802298Z info model Full push, new service openshift-ingress/e2e-inf-a-917d1b-openshift-default.openshift-ingress.svc.cluster.local 2026-07-13T20:18:43.902796Z info ads Push debounce stable[477] 1 for config ServiceEntry/openshift-ingress/e2e-inf-a-917d1b-openshift-default.openshift-ingress.svc.cluster.local: 100.440214ms since last change, 100.440149ms since last push, full=true 2026-07-13T20:18:43.903390Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-13T20:18:43Z/217 2026-07-13T20:18:43.904171Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:3 removed:0 size:2.6kB cached:0/2 2026-07-13T20:18:43.904214Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:5 removed:0 size:3.1kB cached:0/2 2026-07-13T20:18:43.904277Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:2 removed:0 size:174B empty:2 cached:0/2 2026-07-13T20:18:43.904301Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:2 removed:0 size:174B empty:0 cached:2/2 2026-07-13T20:18:43.904215Z info delta CDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:4 removed:0 size:3.0kB cached:0/2 2026-07-13T20:18:43.904509Z info delta EDS: PUSH INC for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:2 removed:0 size:174B empty:0 cached:2/2 2026-07-13T20:18:43.904561Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:18:43.904578Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:18:43.904643Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:18:43.905642Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:18:43.948668Z info delta LDS: PUSH request for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:18:43.953822Z warn constructed http route config for route https.443.default.e2e-inf-a-917d1b-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:18:43.953895Z info delta RDS: PUSH request for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:122B cached:0/0 filtered:0 2026-07-13T20:18:43.954213Z info delta SDS: PUSH request for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:4.5kB cached:0/1 filtered:0 2026-07-13T20:18:44.805667Z info delta CDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:135 removed:0 size:155.6kB cached:2/133 2026-07-13T20:18:44.806976Z info delta EDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:133 removed:0 size:32.0kB empty:0 cached:131/133 2026-07-13T20:18:44.808654Z info delta LDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:18:44.808807Z warn constructed http route config for route https.443.default.e2e-inf-a-917d1b-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:18:44.808881Z info delta RDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-13T20:18:44.808954Z info delta SDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:18:44.820936Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:44.820970Z info gateway reconciling gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:44.856134Z info gateway gateway updated gateway=openshift-ingress/e2e-inf-a-917d1b 2026-07-13T20:18:44.906159Z info ads Push debounce stable[478] 1 for config ServiceEntry/openshift-ingress/e2e-inf-a-917d1b-openshift-default.openshift-ingress.svc.cluster.local: 100.638079ms since last change, 100.638009ms since last push, full=false 2026-07-13T20:18:44.906231Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:43Z/217 2026-07-13T20:18:45.827828Z info ads Push debounce stable[479] 7 for config ConfigMap/ai-tenant-e2e-inf-a-917d1b/kube-root-ca.crt and 3 more configs: 100.674894ms since last change, 154.64956ms since last push, full=false 2026-07-13T20:18:45.827917Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:43Z/217 2026-07-13T20:18:49.254799Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|15021||e2e-inf-a-917d1b-openshift-default.openshift-ingress.svc.cluster.local": {}, "outbound|443||e2e-inf-a-917d1b-openshift-default.openshift-ingress.svc.cluster.local": {} } } 2026-07-13T20:18:50.298506Z info ads Push debounce stable[480] 1 for config Gateway/openshift-ingress/e2e-inf-a-917d1b-istio-autogenerated-k8s-gateway-https: 100.223148ms since last change, 100.223086ms since last push, full=true 2026-07-13T20:18:50.298647Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:18:50.299004Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:18:50.299160Z info delta LDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:18:50.299203Z warn constructed http route config for route https.443.default.e2e-inf-a-917d1b-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:18:50.299284Z info delta RDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-13T20:18:50.299290Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:18:50.299398Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:18:50.300069Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:19:38.114993Z info ads Push debounce stable[481] 1 for config Secret/kube-system/argocd-manager-dockercfg-sv5br: 100.072362ms since last change, 100.072295ms since last push, full=false 2026-07-13T20:19:38.115060Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:20:06.116635Z info ads Push debounce stable[482] 3 for config Secret/cert-manager-operator/builder-dockercfg-mrjtz and 2 more configs: 100.186091ms since last change, 101.744396ms since last push, full=false 2026-07-13T20:20:06.116694Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:20:34.115309Z info ads Push debounce stable[483] 1 for config Secret/cert-manager-operator/cert-manager-operator-controller-manager-dockercfg-h8mcc: 100.227406ms since last change, 100.227334ms since last push, full=false 2026-07-13T20:20:34.115375Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:20:39.135191Z info ads Push debounce stable[484] 7 for config Secret/cert-manager/builder-dockercfg-dxpqz and 6 more configs: 100.644593ms since last change, 119.53303ms since last push, full=false 2026-07-13T20:20:39.135287Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:20:42.117044Z info ads Push debounce stable[485] 1 for config Secret/cert-manager/cert-manager-cainjector-dockercfg-2bnhp: 100.186912ms since last change, 100.186844ms since last push, full=false 2026-07-13T20:20:42.117108Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:20:49.116055Z info ads Push debounce stable[486] 1 for config Secret/cert-manager/cert-manager-dockercfg-qpnnq: 100.42961ms since last change, 100.429536ms since last push, full=false 2026-07-13T20:20:49.116157Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:20:51.115500Z info ads Push debounce stable[487] 1 for config Secret/openshift-lws-operator/openshift-lws-operator-dockercfg-n9cdq: 100.448213ms since last change, 100.448152ms since last push, full=false 2026-07-13T20:20:51.115564Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:20:58.119166Z info ads Push debounce stable[488] 3 for config Secret/opendatahub/default-dockercfg-w448t and 2 more configs: 100.164878ms since last change, 104.388044ms since last push, full=false 2026-07-13T20:20:58.119230Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:21:06.155568Z info delta ADS: "10.134.0.34:35546" maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress-3 terminated 2026-07-13T20:21:06.311707Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress-12 2026-07-13T20:21:06.312835Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:136 removed:0 size:155.7kB cached:131/133 filtered:0 2026-07-13T20:21:06.314197Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:133 removed:0 size:32.0kB empty:0 cached:133/133 filtered:0 2026-07-13T20:21:06.314552Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB filtered:0 2026-07-13T20:21:06.314631Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-07-13T20:21:06.315670Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 filtered:0 2026-07-13T20:21:06.321994Z info delta ECDS: PUSH request for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB filtered:0 2026-07-13T20:21:16.115118Z info ads Push debounce stable[489] 1 for config Secret/opendatahub/opendatahub-operator-controller-manager-dockercfg-74247: 100.221311ms since last change, 100.221195ms since last push, full=false 2026-07-13T20:21:16.115179Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:21:25.114553Z info ads Push debounce stable[490] 1 for config Secret/openshift-lws-operator/lws-controller-manager-dockercfg-kjrwv: 100.213397ms since last change, 100.213322ms since last push, full=false 2026-07-13T20:21:25.114617Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:21:36.118290Z info ads Push debounce stable[491] 3 for config Secret/opendatahub-monitoring/builder-dockercfg-66wvc and 2 more configs: 100.228093ms since last change, 103.78558ms since last push, full=false 2026-07-13T20:21:36.118346Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:21:37.117669Z info ads Push debounce stable[492] 2 for config Secret/opendatahub/odh-model-controller-dockercfg-hxhdj and 1 more configs: 100.221253ms since last change, 100.224123ms since last push, full=false 2026-07-13T20:21:37.117730Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:21:38.117446Z info ads Push debounce stable[493] 2 for config Secret/opendatahub/model-serving-api-dockercfg-ftnfm and 1 more configs: 100.839766ms since last change, 103.515285ms since last push, full=false 2026-07-13T20:21:38.117500Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:21:48.118810Z info ads Push debounce stable[494] 2 for config Secret/opendatahub/llmisvc-controller-manager-dockercfg-8jh6x and 1 more configs: 100.166499ms since last change, 102.688629ms since last push, full=false 2026-07-13T20:21:48.118887Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:21:49.116711Z info ads Push debounce stable[495] 1 for config Secret/openshift-ingress/data-science-gateway-data-science-gateway-class-dockercfg-mrgm7: 100.322811ms since last change, 100.322749ms since last push, full=false 2026-07-13T20:21:49.116765Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:22:00.429618Z info ads Push debounce stable[496] 3 for config Secret/ai-tenant-e2e-inf-a-917d1b/builder-dockercfg-x77np and 2 more configs: 100.240534ms since last change, 109.041583ms since last push, full=false 2026-07-13T20:22:00.429676Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:22:00.675080Z info ads Push debounce stable[497] 1 for config ConfigMap/ai-tenant-e2e-inf-a-917d1b/kube-root-ca.crt: 100.849595ms since last change, 100.849525ms since last push, full=false 2026-07-13T20:22:00.675159Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-13T20:18:50Z/218 2026-07-13T20:22:01.145945Z info ads Push debounce stable[498] 1 for config Gateway/openshift-ingress/e2e-inf-a-917d1b-istio-autogenerated-k8s-gateway-https: 100.225975ms since last change, 100.225905ms since last push, full=true 2026-07-13T20:22:01.146067Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-13T20:22:01Z/219 2026-07-13T20:22:01.146419Z info delta LDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-13T20:22:01.146439Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:22:01.146448Z warn constructed http route config for route https.443.default.e2e-inf-a-917d1b-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-13T20:22:01.146482Z info delta RDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-13T20:22:01.146418Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:22:01.146598Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:22:01.148145Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:22:01.324321Z info model Incremental push, service e2e-inf-a-917d1b-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-13T20:22:01.424602Z info ads Push debounce stable[499] 6 for config Secret/openshift-ingress/e2e-inf-a-917d1b-gw-service-tls and 4 more configs: 100.164451ms since last change, 119.916344ms since last push, full=true 2026-07-13T20:22:01.425233Z info ads XDS: Pushing Services:103 ConnectedEndpoints:3 Version:2026-07-13T20:22:01Z/220 2026-07-13T20:22:01.426361Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:132 removed:2 size:152.7kB cached:131/131 2026-07-13T20:22:01.426481Z info delta CDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:132 removed:3 size:152.7kB cached:131/131 2026-07-13T20:22:01.426366Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:134 removed:2 size:153.1kB cached:131/131 2026-07-13T20:22:01.427122Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-13T20:22:01.427189Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-13T20:22:01.427414Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-13T20:22:01.427413Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-13T20:22:01.427523Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-13T20:22:01.427567Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf469vbq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-13T20:22:01.428030Z info delta EDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-13T20:22:01.428066Z info delta LDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:0 removed:1 size:0B 2026-07-13T20:22:01.428078Z warn buildGatewayRoutes: no gateways for router e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress 2026-07-13T20:22:01.428095Z info delta RDS: PUSH for node:e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress resources:1 removed:0 size:94B cached:0/0 2026-07-13T20:22:01.428109Z warn ads proxy e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress attempted to access unauthorized certificates e2e-inf-a-917d1b-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-13T20:22:01.428416Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-13T20:22:01.428453Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-13T20:22:01.435321Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-13T20:22:06.350165Z info delta ADS: "10.134.0.45:50740" e2e-inf-a-917d1b-openshift-default-7596c88fb5-m5tn8.openshift-ingress-11 terminated 2026-07-13T20:22:09.254766Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-76xxg.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } }