2026-07-24T16:24:42.089494Z info ads XDS: Pushing Services:117 ConnectedEndpoints:6 Version:2026-07-24T16:24:42Z/543 2026-07-24T16:24:42.090080Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:42.090120Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:42.090251Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:24:42.090080Z info delta LDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:42.090434Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:24:42.090465Z info delta LDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T16:24:42.090562Z warn constructed http route config for route https.443.default.e2e-ipp-a-5d0582-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:24:42.090640Z info delta RDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T16:24:42.090641Z info delta RDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:3.7kB cached:0/0 2026-07-24T16:24:42.090334Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:42.090962Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:24:42.090471Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:24:42.091618Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:24:42.347862Z info ads Push debounce stable[966] 1 for config ConfigMap/ai-tenant-e2e-ipp-a-5d0582/kube-root-ca.crt: 100.257305ms since last change, 100.257243ms since last push, full=false 2026-07-24T16:24:42.347932Z info ads XDS: Incremental Pushing ConnectedEndpoints:6 Version:2026-07-24T16:24:42Z/543 2026-07-24T16:24:42.431491Z info model Incremental push, service ipp-route-5d0582-kserve-workload-svc.ai-tenant-e2e-ipp-a-5d0582.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:24:42.531566Z info ads Push debounce stable[967] 2 for config ServiceEntry/ai-tenant-e2e-ipp-a-5d0582/ipp-route-5d0582-kserve-workload-svc.ai-tenant-e2e-ipp-a-5d0582.svc.cluster.local: 100.034157ms since last change, 110.115244ms since last push, full=true 2026-07-24T16:24:42.532239Z info ads XDS: Pushing Services:116 ConnectedEndpoints:6 Version:2026-07-24T16:24:42Z/544 2026-07-24T16:24:42.532847Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:1 size:44B 2026-07-24T16:24:42.532855Z info delta CDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:3 removed:1 size:507B 2026-07-24T16:24:42.532918Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T16:24:42.532963Z info delta CDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:3 removed:1 size:507B 2026-07-24T16:24:42.533065Z info delta EDS: PUSH INC for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T16:24:42.533208Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:24:42.533090Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:3 removed:1 size:507B 2026-07-24T16:24:42.533398Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:24:42.533406Z info delta CDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:2 removed:1 size:372B 2026-07-24T16:24:42.533540Z info delta EDS: PUSH INC for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T16:24:42.533211Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:3 removed:1 size:507B 2026-07-24T16:24:42.533779Z info delta LDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T16:24:42.533804Z warn constructed http route config for route https.443.default.e2e-ipp-a-5d0582-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:24:42.533826Z info delta RDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T16:24:42.533828Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T16:24:42.533384Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:42.534106Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:42.533469Z info delta EDS: PUSH INC for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T16:24:42.534408Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:24:42.534623Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:42.532922Z info delta EDS: PUSH INC for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T16:24:42.534880Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:24:42.535154Z info delta LDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:42.535441Z info delta RDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:3.7kB cached:0/0 2026-07-24T16:24:42.535737Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:24:43.346097Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T16:24:43.847912Z info ads Push debounce stable[968] 1 for config DestinationRule/ai-tenant-e2e-ipp-a-5d0582/ipp-route-5d0582-kserve-workload-svc: 100.309327ms since last change, 100.309256ms since last push, full=true 2026-07-24T16:24:43.848114Z info ads XDS: Pushing Services:116 ConnectedEndpoints:6 Version:2026-07-24T16:24:43Z/545 2026-07-24T16:24:43.848662Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:3 removed:0 size:507B 2026-07-24T16:24:43.848711Z info delta CDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:2 removed:0 size:372B 2026-07-24T16:24:43.848730Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:44B 2026-07-24T16:24:43.848913Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:3 removed:0 size:507B 2026-07-24T16:24:43.848964Z info delta CDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:3 removed:0 size:507B 2026-07-24T16:24:43.849270Z info delta CDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:3 removed:0 size:507B 2026-07-24T16:24:43.849680Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T16:24:43.849911Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T16:24:43.850022Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:24:43.850071Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T16:24:43.850177Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:24:43.850256Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:43.849690Z info delta EDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T16:24:43.850441Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:43.850658Z info delta LDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T16:24:43.850694Z info delta EDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T16:24:43.850996Z info delta LDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:43.851003Z info delta EDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T16:24:43.851583Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:43.850751Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:24:43.850722Z warn constructed http route config for route https.443.default.e2e-ipp-a-5d0582-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:24:43.852704Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:24:43.852708Z info delta RDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T16:24:43.852171Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:24:43.851279Z info delta RDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:3.7kB cached:0/0 2026-07-24T16:24:50.081989Z info delta ECDS: PUSH request for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:0 removed:0 size:0B filtered:0 2026-07-24T16:24:53.345967Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T16:24:56.005080Z info ads Push debounce stable[969] 1 for config Gateway/openshift-ingress/e2e-ipp-a-5d0582-istio-autogenerated-k8s-gateway-https: 100.22223ms since last change, 100.222158ms since last push, full=true 2026-07-24T16:24:56.005229Z info ads XDS: Pushing Services:116 ConnectedEndpoints:6 Version:2026-07-24T16:24:56Z/546 2026-07-24T16:24:56.005633Z info delta LDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T16:24:56.005643Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:56.005663Z warn constructed http route config for route https.443.default.e2e-ipp-a-5d0582-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:24:56.005693Z info delta RDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T16:24:56.005631Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:56.005643Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:56.005636Z info delta LDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:56.005969Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:24:56.005979Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:24:56.005636Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:24:56.006239Z info delta RDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:3.7kB cached:0/0 2026-07-24T16:24:56.006265Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:24:56.007486Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:24:56.240579Z info model Incremental push, service e2e-ipp-a-5d0582-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:24:56.344952Z info ads Push debounce stable[970] 6 for config Secret/openshift-ingress/e2e-ipp-a-5d0582-openshift-default-dockercfg-z79dc and 4 more configs: 100.93852ms since last change, 128.111265ms since last push, full=true 2026-07-24T16:24:56.345787Z info ads XDS: Pushing Services:115 ConnectedEndpoints:6 Version:2026-07-24T16:24:56Z/547 2026-07-24T16:24:56.347486Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:149 removed:2 size:171.7kB cached:146/146 2026-07-24T16:24:56.347620Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:149 removed:2 size:171.7kB cached:146/146 2026-07-24T16:24:56.347842Z info delta CDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:149 removed:2 size:171.7kB cached:146/146 2026-07-24T16:24:56.347900Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:147 removed:2 size:171.2kB cached:146/146 2026-07-24T16:24:56.347900Z info delta CDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:147 removed:3 size:171.2kB cached:146/146 2026-07-24T16:24:56.347907Z info delta CDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:149 removed:2 size:171.7kB cached:146/146 2026-07-24T16:24:56.348592Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T16:24:56.348763Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T16:24:56.348915Z info delta EDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T16:24:56.349025Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:56.349081Z info delta EDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T16:24:56.349321Z info delta EDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T16:24:56.349401Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:56.349115Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:24:56.349591Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:24:56.349640Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T16:24:56.349126Z info delta LDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:56.349914Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:24:56.349985Z info delta SDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:24:56.350026Z info delta RDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:3.7kB cached:0/0 2026-07-24T16:24:56.350091Z info delta SDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:24:56.350888Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:24:56.350974Z info delta ECDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:24:56.350985Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:24:56.348654Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T16:24:56.351513Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:24:56.349404Z info delta LDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:0 removed:1 size:0B 2026-07-24T16:24:56.351826Z warn buildGatewayRoutes: no gateways for router e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress 2026-07-24T16:24:56.351920Z info delta RDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:1 removed:0 size:94B cached:0/0 2026-07-24T16:24:56.351982Z warn ads proxy e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress attempted to access unauthorized certificates e2e-ipp-a-5d0582-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-24T16:24:56.352047Z info delta ECDS: PUSH for node:e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T16:24:56.351829Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:24:56.352177Z info delta SDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:24:56.351021Z info delta ECDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:24:56.353207Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:24:56.362942Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:01.264195Z info delta ADS: "10.134.0.54:47300" e2e-ipp-a-5d0582-openshift-default-5f875678f8-ld8x8.openshift-ingress-32 terminated 2026-07-24T16:25:03.345998Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T16:25:06.703416Z info model Incremental push, service maas-api-e2e-ipp-b-07e89c.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:06.778866Z info model Incremental push, service payload-processing-e2e-ipp-b-07e89c.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:06.789456Z info model Full push, new service openshift-ingress/payload-pre-processing-e2e-ipp-b-07e89c.openshift-ingress.svc.cluster.local 2026-07-24T16:25:06.796997Z info model Incremental push, service payload-pre-processing-e2e-ipp-b-07e89c.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:06.932610Z info ads Push debounce stable[971] 14 for config ServiceEntry/odh-ai-gateway-infra/maas-api-e2e-ipp-b-07e89c.odh-ai-gateway-infra.svc.cluster.local and 9 more configs: 100.380636ms since last change, 238.265715ms since last push, full=true 2026-07-24T16:25:06.933372Z info ads XDS: Pushing Services:112 ConnectedEndpoints:5 Version:2026-07-24T16:25:06Z/548 2026-07-24T16:25:06.934709Z info delta CDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:146 removed:3 size:168.1kB cached:143/143 2026-07-24T16:25:06.935068Z info delta CDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:146 removed:3 size:168.1kB cached:143/143 2026-07-24T16:25:06.935090Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:146 removed:3 size:168.1kB cached:143/143 2026-07-24T16:25:06.935118Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:144 removed:3 size:167.7kB cached:143/143 2026-07-24T16:25:06.935250Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:146 removed:3 size:168.1kB cached:143/143 2026-07-24T16:25:06.935400Z info delta EDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:146 removed:0 size:35.0kB empty:3 cached:143/146 2026-07-24T16:25:06.935762Z info delta LDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T16:25:06.935857Z warn constructed http route config for route https.443.default.e2e-ipp-b-07e89c-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:25:06.935938Z info delta RDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T16:25:06.936006Z info delta SDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:06.936028Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:146 removed:0 size:35.0kB empty:3 cached:143/146 2026-07-24T16:25:06.936197Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:146 removed:0 size:35.0kB empty:3 cached:143/146 2026-07-24T16:25:06.936318Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:06.936514Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:146 removed:0 size:35.0kB empty:3 cached:143/146 2026-07-24T16:25:06.936535Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:06.936222Z info delta EDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:146 removed:0 size:35.0kB empty:3 cached:143/146 2026-07-24T16:25:06.936634Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:25:06.936686Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:06.936718Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T16:25:06.936777Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:06.936796Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:06.936853Z info delta SDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:06.936980Z info delta ECDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:06.937048Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:06.937097Z info delta SDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:06.937865Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:06.937907Z info delta ECDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:06.938349Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:25:06.938400Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:06.950499Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:10.647354Z info ads Push debounce stable[972] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-ipp-b-07e89c: 100.184591ms since last change, 100.184512ms since last push, full=true 2026-07-24T16:25:10.647609Z info ads XDS: Pushing Services:112 ConnectedEndpoints:5 Version:2026-07-24T16:25:10Z/549 2026-07-24T16:25:10.648788Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:146 removed:0 size:168.1kB cached:143/143 2026-07-24T16:25:10.648942Z info delta CDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:145 removed:1 size:168.0kB cached:141/143 2026-07-24T16:25:10.649036Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:144 removed:0 size:167.7kB cached:143/143 2026-07-24T16:25:10.649043Z info delta CDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:146 removed:0 size:168.1kB cached:143/143 2026-07-24T16:25:10.648957Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:146 removed:0 size:168.1kB cached:143/143 2026-07-24T16:25:10.649831Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:143 removed:0 size:34.8kB empty:0 cached:143/143 2026-07-24T16:25:10.650051Z info delta EDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:143 removed:0 size:34.8kB empty:0 cached:143/143 2026-07-24T16:25:10.650194Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:10.650397Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:10.650611Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:10.650731Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:10.650911Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:143 removed:0 size:34.8kB empty:0 cached:143/143 2026-07-24T16:25:10.650206Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:143 removed:0 size:34.8kB empty:0 cached:143/143 2026-07-24T16:25:10.651210Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:10.651392Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:25:10.650088Z info delta EDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:143 removed:0 size:34.8kB empty:0 cached:143/143 2026-07-24T16:25:10.651500Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:10.651252Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:10.651673Z info delta ECDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:10.651699Z info delta LDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T16:25:10.651791Z warn constructed http route config for route https.443.default.e2e-ipp-b-07e89c-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:25:10.651851Z info delta RDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T16:25:10.652750Z info delta ECDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:10.653208Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:25:10.665349Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:11.048635Z info ads Push debounce stable[973] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-ipp-b-07e89c: 100.229607ms since last change, 100.229545ms since last push, full=true 2026-07-24T16:25:11.058644Z info ads XDS: Pushing Services:112 ConnectedEndpoints:5 Version:2026-07-24T16:25:11Z/550 2026-07-24T16:25:11.059030Z info delta LDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T16:25:11.059083Z info delta ECDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T16:25:11.059030Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:11.059125Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:11.059029Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:11.059030Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:11.060026Z info delta ECDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:11.060141Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:11.068659Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:17.540473Z info ads Push debounce stable[974] 3 for config Secret/ai-tenant-e2e-ipp-b-07e89c/default-dockercfg-cbs9n and 2 more configs: 100.27871ms since last change, 101.413829ms since last push, full=false 2026-07-24T16:25:17.540555Z info ads XDS: Incremental Pushing ConnectedEndpoints:5 Version:2026-07-24T16:25:11Z/550 2026-07-24T16:25:17.689146Z info ads Push debounce stable[975] 1 for config ConfigMap/ai-tenant-e2e-ipp-b-07e89c/kube-root-ca.crt: 100.29083ms since last change, 100.290757ms since last push, full=false 2026-07-24T16:25:17.689203Z info ads XDS: Incremental Pushing ConnectedEndpoints:5 Version:2026-07-24T16:25:11Z/550 2026-07-24T16:25:18.573897Z info ads Push debounce stable[976] 1 for config Gateway/openshift-ingress/e2e-ipp-b-07e89c-istio-autogenerated-k8s-gateway-https: 100.225518ms since last change, 100.225438ms since last push, full=true 2026-07-24T16:25:18.574046Z info ads XDS: Pushing Services:112 ConnectedEndpoints:5 Version:2026-07-24T16:25:18Z/551 2026-07-24T16:25:18.574451Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:18.574469Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:18.574459Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:18.574763Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:18.574816Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:18.574469Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:18.574460Z info delta LDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T16:25:18.575278Z warn constructed http route config for route https.443.default.e2e-ipp-b-07e89c-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:25:18.575417Z info delta RDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T16:25:18.575179Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:25:18.576428Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:25:18.760947Z info model Incremental push, service e2e-ipp-b-07e89c-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:18.861856Z info ads Push debounce stable[977] 6 for config EnvoyFilter/openshift-ingress/e2e-ipp-b-07e89c-authn-ssl and 4 more configs: 100.191239ms since last change, 128.806648ms since last push, full=true 2026-07-24T16:25:18.862591Z info ads XDS: Pushing Services:111 ConnectedEndpoints:5 Version:2026-07-24T16:25:18Z/552 2026-07-24T16:25:18.863931Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:142 removed:2 size:165.1kB cached:141/141 2026-07-24T16:25:18.864060Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:144 removed:2 size:165.5kB cached:141/141 2026-07-24T16:25:18.864146Z info delta CDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:142 removed:3 size:165.1kB cached:141/141 2026-07-24T16:25:18.864232Z info delta CDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:144 removed:2 size:165.5kB cached:141/141 2026-07-24T16:25:18.864190Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:144 removed:2 size:165.5kB cached:141/141 2026-07-24T16:25:18.864912Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:143 removed:0 size:34.4kB empty:2 cached:141/143 2026-07-24T16:25:18.864976Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:143 removed:0 size:34.4kB empty:2 cached:141/143 2026-07-24T16:25:18.865217Z info delta EDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:143 removed:0 size:34.4kB empty:2 cached:141/143 2026-07-24T16:25:18.865289Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:18.865355Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:143 removed:0 size:34.4kB empty:2 cached:141/143 2026-07-24T16:25:18.865422Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:25:18.865500Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T16:25:18.865532Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:18.865639Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:18.865291Z info delta EDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:143 removed:0 size:34.4kB empty:2 cached:141/143 2026-07-24T16:25:18.865789Z info delta LDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:0 removed:1 size:0B 2026-07-24T16:25:18.865825Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:18.865370Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:18.865867Z info delta SDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:18.865930Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:18.865978Z info delta SDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:18.865829Z warn buildGatewayRoutes: no gateways for router e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress 2026-07-24T16:25:18.866187Z info delta RDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:1 removed:0 size:94B cached:0/0 2026-07-24T16:25:18.866215Z warn ads proxy e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress attempted to access unauthorized certificates e2e-ipp-b-07e89c-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-24T16:25:18.866248Z info delta ECDS: PUSH for node:e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T16:25:18.866803Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:18.866805Z info delta ECDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:18.867473Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:25:18.867526Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:18.880445Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:23.345248Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T16:25:23.784826Z info delta ADS: "10.134.0.55:43800" e2e-ipp-b-07e89c-openshift-default-55f5cb9544-9tq6d.openshift-ingress-33 terminated 2026-07-24T16:25:31.427801Z info model Incremental push, service maas-api-e2e-shared-a-fafc28.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:31.492872Z info model Incremental push, service payload-processing-e2e-shared-a-fafc28.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:31.512605Z info model Incremental push, service payload-pre-processing-e2e-shared-a-fafc28.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:31.666346Z info ads Push debounce stable[978] 13 for config ServiceEntry/odh-ai-gateway-infra/maas-api-e2e-shared-a-fafc28.odh-ai-gateway-infra.svc.cluster.local and 9 more configs: 100.165281ms since last change, 249.655782ms since last push, full=true 2026-07-24T16:25:31.667048Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-24T16:25:31Z/553 2026-07-24T16:25:31.668127Z info delta CDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:141 removed:3 size:162.0kB cached:138/138 2026-07-24T16:25:31.668413Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:139 removed:3 size:161.5kB cached:138/138 2026-07-24T16:25:31.668686Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:141 removed:3 size:162.0kB cached:138/138 2026-07-24T16:25:31.668896Z info delta EDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:141 removed:0 size:33.7kB empty:3 cached:138/141 2026-07-24T16:25:31.669105Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:141 removed:0 size:33.7kB empty:3 cached:138/141 2026-07-24T16:25:31.669210Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T16:25:31.669248Z warn constructed http route config for route https.443.default.e2e-shared-a-fafc28-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:25:31.669285Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T16:25:31.669353Z info delta SDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:31.668689Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:141 removed:3 size:162.0kB cached:138/138 2026-07-24T16:25:31.669556Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:31.669721Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:25:31.669834Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T16:25:31.669486Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:141 removed:0 size:33.7kB empty:3 cached:138/141 2026-07-24T16:25:31.670177Z info delta ECDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:31.670204Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:141 removed:0 size:33.7kB empty:3 cached:138/141 2026-07-24T16:25:31.670220Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:31.670519Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:31.670680Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:31.670745Z info delta SDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:31.671583Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:31.672072Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:25:31.672124Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:31.684108Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:33.345233Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T16:25:34.946919Z info ads Push debounce stable[979] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-shared-a-fafc28: 100.248844ms since last change, 100.248772ms since last push, full=true 2026-07-24T16:25:34.947144Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-24T16:25:34Z/554 2026-07-24T16:25:34.948224Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:141 removed:0 size:162.0kB cached:138/138 2026-07-24T16:25:34.948419Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:139 removed:0 size:161.5kB cached:138/138 2026-07-24T16:25:34.948496Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:141 removed:0 size:162.0kB cached:138/138 2026-07-24T16:25:34.948544Z info delta CDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:140 removed:1 size:161.8kB cached:131/138 2026-07-24T16:25:34.948992Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:138/138 2026-07-24T16:25:34.949399Z info delta EDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:138/138 2026-07-24T16:25:34.949412Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:138/138 2026-07-24T16:25:34.949746Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T16:25:34.949421Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:138/138 2026-07-24T16:25:34.949889Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:34.950003Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:25:34.949421Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:34.950210Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:34.950571Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:34.949796Z warn constructed http route config for route https.443.default.e2e-shared-a-fafc28-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:25:34.950784Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T16:25:34.951618Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:34.951627Z info delta ECDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:34.951903Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:25:34.959562Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:35.245100Z info ads Push debounce stable[980] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-fafc28: 100.213392ms since last change, 100.213325ms since last push, full=true 2026-07-24T16:25:35.254948Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-24T16:25:35Z/555 2026-07-24T16:25:35.255289Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:35.255331Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:35.255338Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:35.255290Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T16:25:35.255590Z info delta ECDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T16:25:35.256140Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:35.264052Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:40.146550Z info ads Push debounce stable[981] 1 for config ConfigMap/ai-tenant-e2e-shared-a-fafc28/kube-root-ca.crt: 100.096411ms since last change, 100.096312ms since last push, full=false 2026-07-24T16:25:40.146615Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-24T16:25:35Z/555 2026-07-24T16:25:40.944079Z info ads Push debounce stable[982] 3 for config Secret/ai-tenant-e2e-shared-a-fafc28/builder-dockercfg-jp5x7 and 2 more configs: 100.149821ms since last change, 112.251801ms since last push, full=false 2026-07-24T16:25:40.944137Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-24T16:25:35Z/555 2026-07-24T16:25:41.439967Z info ads Push debounce stable[983] 1 for config Gateway/openshift-ingress/e2e-shared-a-fafc28-istio-autogenerated-k8s-gateway-https: 100.22792ms since last change, 100.227849ms since last push, full=true 2026-07-24T16:25:41.440107Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-24T16:25:41Z/556 2026-07-24T16:25:41.440516Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:41.440595Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T16:25:41.440603Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:41.440620Z warn constructed http route config for route https.443.default.e2e-shared-a-fafc28-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:25:41.440645Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T16:25:41.440514Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:41.440809Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:41.440887Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:25:41.442170Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:25:41.633700Z info model Incremental push, service e2e-shared-a-fafc28-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:41.734288Z info ads Push debounce stable[984] 6 for config Secret/openshift-ingress/e2e-shared-a-fafc28-gw-service-tls and 4 more configs: 100.281392ms since last change, 127.648526ms since last push, full=true 2026-07-24T16:25:41.735013Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-24T16:25:41Z/557 2026-07-24T16:25:41.736408Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:137 removed:2 size:158.9kB cached:136/136 2026-07-24T16:25:41.736459Z info delta CDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:137 removed:3 size:158.9kB cached:136/136 2026-07-24T16:25:41.736690Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:139 removed:2 size:159.3kB cached:136/136 2026-07-24T16:25:41.736690Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:139 removed:2 size:159.3kB cached:136/136 2026-07-24T16:25:41.737250Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:138 removed:0 size:33.0kB empty:2 cached:136/138 2026-07-24T16:25:41.737547Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:138 removed:0 size:33.0kB empty:2 cached:136/138 2026-07-24T16:25:41.737686Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:41.737289Z info delta EDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:138 removed:0 size:33.0kB empty:2 cached:136/138 2026-07-24T16:25:41.737828Z info delta LDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:0 removed:1 size:0B 2026-07-24T16:25:41.737867Z warn buildGatewayRoutes: no gateways for router e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress 2026-07-24T16:25:41.737922Z info delta RDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-24T16:25:41.737965Z warn ads proxy e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress attempted to access unauthorized certificates e2e-shared-a-fafc28-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-24T16:25:41.737725Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:138 removed:0 size:33.0kB empty:2 cached:136/138 2026-07-24T16:25:41.738278Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:41.737938Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:41.738754Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T16:25:41.738799Z info delta SDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:41.737852Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:25:41.739413Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T16:25:41.738019Z info delta ECDS: PUSH for node:e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T16:25:41.739527Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:41.740141Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:25:41.740190Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:41.752210Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:43.346084Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T16:25:46.666293Z info delta ADS: "10.134.0.50:33602" e2e-shared-a-fafc28-openshift-default-865967cd4-45296.openshift-ingress-28 terminated 2026-07-24T16:25:52.745119Z info model Incremental push, service maas-api-e2e-shared-b-c6c91e.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:52.846332Z info model Incremental push, service payload-processing-e2e-shared-b-c6c91e.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:52.868055Z info model Full push, new service openshift-ingress/payload-pre-processing-e2e-shared-b-c6c91e.openshift-ingress.svc.cluster.local 2026-07-24T16:25:52.880121Z info model Incremental push, service payload-pre-processing-e2e-shared-b-c6c91e.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:25:53.042506Z info ads Push debounce stable[985] 14 for config Secret/openshift-ingress/payload-processing-e2e-shared-b-c6c91e-dockercfg-kjpdh and 9 more configs: 100.161279ms since last change, 320.565761ms since last push, full=true 2026-07-24T16:25:53.043195Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-24T16:25:53Z/558 2026-07-24T16:25:53.044440Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:136 removed:3 size:155.8kB cached:133/133 2026-07-24T16:25:53.044993Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:136 removed:3 size:155.8kB cached:133/133 2026-07-24T16:25:53.045013Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:134 removed:3 size:155.3kB cached:133/133 2026-07-24T16:25:53.046511Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:136 removed:0 size:32.4kB empty:3 cached:133/136 2026-07-24T16:25:53.046682Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:136 removed:0 size:32.4kB empty:3 cached:133/136 2026-07-24T16:25:53.047271Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T16:25:53.047525Z warn constructed http route config for route https.443.default.e2e-shared-b-c6c91e-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:25:53.047594Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:53.047749Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:25:53.047812Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T16:25:53.047973Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T16:25:53.048033Z info delta SDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:53.048035Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:136 removed:0 size:32.4kB empty:3 cached:133/136 2026-07-24T16:25:53.052391Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:53.049132Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:53.054449Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:25:53.054826Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:25:53.063228Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:53.345107Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T16:25:54.850474Z info ads Push debounce stable[986] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-shared-b-c6c91e: 100.854208ms since last change, 100.854124ms since last push, full=true 2026-07-24T16:25:54.850721Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-24T16:25:54Z/559 2026-07-24T16:25:54.851722Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:136 removed:0 size:155.8kB cached:133/133 2026-07-24T16:25:54.851723Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:134 removed:0 size:155.3kB cached:133/133 2026-07-24T16:25:54.852017Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:135 removed:1 size:155.6kB cached:131/133 2026-07-24T16:25:54.852426Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-24T16:25:54.852793Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:54.852845Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-24T16:25:54.852808Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-24T16:25:54.853113Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T16:25:54.853162Z warn constructed http route config for route https.443.default.e2e-shared-b-c6c91e-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:25:54.853215Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T16:25:54.853364Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:54.853521Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:25:54.854017Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T16:25:54.854557Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:25:54.865138Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:25:55.349260Z info ads Push debounce stable[987] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-c6c91e: 100.232461ms since last change, 100.232384ms since last push, full=true 2026-07-24T16:25:55.358664Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-24T16:25:55Z/560 2026-07-24T16:25:55.359017Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T16:25:55.359052Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:25:55.359066Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T16:25:55.359088Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:25:55.367625Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:26:03.543825Z info ads Push debounce stable[988] 4 for config Secret/ai-tenant-e2e-shared-b-c6c91e/default-dockercfg-nr5hm and 3 more configs: 100.280826ms since last change, 194.744507ms since last push, full=false 2026-07-24T16:26:03.543903Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-24T16:25:55Z/560 2026-07-24T16:26:04.903068Z info ads Push debounce stable[989] 1 for config Gateway/openshift-ingress/e2e-shared-b-c6c91e-istio-autogenerated-k8s-gateway-https: 100.301733ms since last change, 100.301649ms since last push, full=true 2026-07-24T16:26:04.903189Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-24T16:26:04Z/561 2026-07-24T16:26:04.903521Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T16:26:04.903532Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:26:04.903543Z warn constructed http route config for route https.443.default.e2e-shared-b-c6c91e-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T16:26:04.903565Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T16:26:04.903564Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:26:04.903661Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:26:04.905102Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:26:05.196340Z info model Incremental push, service e2e-shared-b-c6c91e-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T16:26:05.340891Z info ads Push debounce stable[990] 6 for config Gateway/openshift-ingress/e2e-shared-b-c6c91e-istio-autogenerated-k8s-gateway-https and 4 more configs: 100.629635ms since last change, 212.810385ms since last push, full=true 2026-07-24T16:26:05.341608Z info ads XDS: Pushing Services:103 ConnectedEndpoints:3 Version:2026-07-24T16:26:05Z/562 2026-07-24T16:26:05.342840Z info delta CDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:132 removed:3 size:152.7kB cached:131/131 2026-07-24T16:26:05.343050Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:132 removed:2 size:152.7kB cached:131/131 2026-07-24T16:26:05.343050Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:134 removed:2 size:153.1kB cached:131/131 2026-07-24T16:26:05.343528Z info delta EDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-24T16:26:05.343606Z info delta LDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:0 removed:1 size:0B 2026-07-24T16:26:05.343643Z warn buildGatewayRoutes: no gateways for router e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress 2026-07-24T16:26:05.343684Z info delta RDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-24T16:26:05.343724Z warn ads proxy e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress attempted to access unauthorized certificates e2e-shared-b-c6c91e-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-24T16:26:05.343763Z info delta ECDS: PUSH for node:e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T16:26:05.344133Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-24T16:26:05.344538Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T16:26:05.344730Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-24T16:26:05.345072Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T16:26:05.345178Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T16:26:05.345271Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-chnfp.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T16:26:05.346231Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T16:26:05.346281Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T16:26:05.356738Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T16:26:10.276902Z info delta ADS: "10.134.0.51:38062" e2e-shared-b-c6c91e-openshift-default-6649b646d-mqfp4.openshift-ingress-29 terminated 2026-07-24T16:26:13.345580Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-mdfxk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } }