2026-07-24T19:28:27.596906Z info delta ECDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:28:27.596906Z info delta ECDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:28:27.606892Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:28:31.572735Z info ads Push debounce stable[942] 1 for config ServiceEntry/ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-workload-svc.ai-tenant-e2e-ipp-a-2d5d53.svc.cluster.local: 101.048816ms since last change, 101.048732ms since last push, full=false 2026-07-24T19:28:31.572799Z info ads XDS: Incremental Pushing ConnectedEndpoints:6 Version:2026-07-24T19:28:27Z/534 2026-07-24T19:28:34.062284Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|8000||ipp-route-2d5d53-kserve-workload-svc.ai-tenant-e2e-ipp-a-2d5d53.svc.cluster.local": {} } } 2026-07-24T19:28:42.121812Z info ads Push debounce stable[943] 4 for config Secret/premium-users-namespace/default-dockercfg-7z7bm and 3 more configs: 100.216361ms since last change, 101.460513ms since last push, full=false 2026-07-24T19:28:42.121887Z info ads XDS: Incremental Pushing ConnectedEndpoints:6 Version:2026-07-24T19:28:27Z/534 2026-07-24T19:28:43.120808Z info ads Push debounce stable[944] 4 for config Secret/maas-admin/builder-dockercfg-vck8s and 3 more configs: 100.264778ms since last change, 105.567979ms since last push, full=false 2026-07-24T19:28:43.120866Z info ads XDS: Incremental Pushing ConnectedEndpoints:6 Version:2026-07-24T19:28:27Z/534 2026-07-24T19:28:45.115431Z info ads Push debounce stable[945] 1 for config Secret/default/tester-regular-user-dockercfg-q74r7: 100.215044ms since last change, 100.214967ms since last push, full=false 2026-07-24T19:28:45.115484Z info ads XDS: Incremental Pushing ConnectedEndpoints:6 Version:2026-07-24T19:28:27Z/534 2026-07-24T19:28:46.764847Z info model Incremental push, service ipp-route-2d5d53-kserve-workload-svc.ai-tenant-e2e-ipp-a-2d5d53.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:28:46.865114Z info ads Push debounce stable[946] 1 for config ServiceEntry/ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-workload-svc.ai-tenant-e2e-ipp-a-2d5d53.svc.cluster.local: 100.217268ms since last change, 100.217194ms since last push, full=false 2026-07-24T19:28:46.865186Z info ads XDS: Incremental Pushing ConnectedEndpoints:6 Version:2026-07-24T19:28:27Z/534 2026-07-24T19:29:07.720891Z info ads Push debounce stable[947] 5 for config Secret/ai-tenant-e2e-ipp-a-2d5d53/deployer-dockercfg-hthx6 and 4 more configs: 100.279629ms since last change, 109.840411ms since last push, full=false 2026-07-24T19:29:07.720961Z info ads XDS: Incremental Pushing ConnectedEndpoints:6 Version:2026-07-24T19:28:27Z/534 2026-07-24T19:29:07.874709Z info model Incremental push, service ipp-route-2d5d53-kserve-workload-svc.ai-tenant-e2e-ipp-a-2d5d53.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:29:07.974924Z info ads Push debounce stable[948] 2 for config ServiceEntry/ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-workload-svc.ai-tenant-e2e-ipp-a-2d5d53.svc.cluster.local: 100.170339ms since last change, 109.457306ms since last push, full=true 2026-07-24T19:29:07.975591Z info ads XDS: Pushing Services:116 ConnectedEndpoints:6 Version:2026-07-24T19:29:07Z/535 2026-07-24T19:29:07.976099Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:1 size:44B 2026-07-24T19:29:07.976174Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T19:29:07.976287Z info delta CDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:3 removed:1 size:507B 2026-07-24T19:29:07.976453Z info delta EDS: PUSH INC for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T19:29:07.976461Z info delta CDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:3 removed:1 size:507B 2026-07-24T19:29:07.976487Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:29:07.976523Z info delta EDS: PUSH INC for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T19:29:07.976588Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:29:07.976586Z info delta CDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:2 removed:1 size:372B 2026-07-24T19:29:07.976705Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:3 removed:1 size:507B 2026-07-24T19:29:07.976767Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:07.976820Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T19:29:07.976294Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:3 removed:1 size:507B 2026-07-24T19:29:07.977075Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:07.977075Z info delta EDS: PUSH INC for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T19:29:07.976737Z info delta LDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:07.977472Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:07.977646Z info delta RDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:3.7kB cached:0/0 2026-07-24T19:29:07.977077Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:07.976730Z info delta EDS: PUSH INC for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:0 removed:1 size:0B empty:0 cached:0/0 2026-07-24T19:29:07.977717Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:07.978011Z info delta LDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T19:29:07.978269Z info delta RDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:1 removed:0 size:8.8kB cached:0/0 2026-07-24T19:29:07.978765Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:29:08.347089Z info ads Push debounce stable[949] 2 for config VirtualService/ai-tenant-e2e-ipp-a-2d5d53/openshift-ingress~e2e-ipp-a-2d5d53-istio-autogenerated-k8s-gateway-https~* and 1 more configs: 100.929611ms since last change, 178.134359ms since last push, full=true 2026-07-24T19:29:08.347311Z info ads XDS: Pushing Services:116 ConnectedEndpoints:6 Version:2026-07-24T19:29:08Z/536 2026-07-24T19:29:08.347797Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:44B 2026-07-24T19:29:08.347942Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:3 removed:0 size:507B 2026-07-24T19:29:08.347980Z info delta CDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:2 removed:0 size:372B 2026-07-24T19:29:08.348090Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:3 removed:0 size:507B 2026-07-24T19:29:08.348305Z info delta CDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:3 removed:0 size:507B 2026-07-24T19:29:08.348340Z info delta CDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:3 removed:0 size:507B 2026-07-24T19:29:08.349163Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T19:29:08.349195Z info delta EDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T19:29:08.349202Z info delta EDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T19:29:08.349210Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T19:29:08.349483Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:29:08.349509Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:08.349484Z info delta LDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T19:29:08.349688Z warn constructed http route config for route https.443.default.e2e-ipp-a-2d5d53-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:29:08.349747Z info delta RDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T19:29:08.349814Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:29:08.349869Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:08.350089Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:08.350202Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T19:29:08.350464Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:08.350513Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:08.350605Z info delta EDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:148 removed:0 size:36.1kB empty:0 cached:148/148 2026-07-24T19:29:08.350918Z info delta LDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:08.351265Z info delta RDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:3.7kB cached:0/0 2026-07-24T19:29:08.352344Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:29:08.575716Z info ads Push debounce stable[950] 1 for config ConfigMap/ai-tenant-e2e-ipp-a-2d5d53/kube-root-ca.crt: 100.988455ms since last change, 100.988382ms since last push, full=false 2026-07-24T19:29:08.575771Z info ads XDS: Incremental Pushing ConnectedEndpoints:6 Version:2026-07-24T19:29:08Z/536 2026-07-24T19:29:12.607309Z info delta ECDS: PUSH request for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:0 removed:0 size:0B filtered:0 2026-07-24T19:29:14.061359Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T19:29:29.078341Z info ads Push debounce stable[951] 1 for config Gateway/openshift-ingress/e2e-ipp-a-2d5d53-istio-autogenerated-k8s-gateway-https: 100.634042ms since last change, 100.63399ms since last push, full=true 2026-07-24T19:29:29.078494Z info ads XDS: Pushing Services:116 ConnectedEndpoints:6 Version:2026-07-24T19:29:29Z/537 2026-07-24T19:29:29.078873Z info delta LDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:29.078888Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:29.078905Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:29:29.078991Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:29.079009Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:29:29.078888Z info delta LDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T19:29:29.079268Z warn constructed http route config for route https.443.default.e2e-ipp-a-2d5d53-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:29:29.079302Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:29.079154Z info delta RDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:3.7kB cached:0/0 2026-07-24T19:29:29.078888Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:29.079307Z info delta RDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T19:29:29.079602Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:29.080182Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:29:29.249793Z info model Incremental push, service e2e-ipp-a-2d5d53-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:29:29.350901Z info ads Push debounce stable[952] 6 for config Secret/openshift-ingress/e2e-ipp-a-2d5d53-gw-service-tls and 4 more configs: 100.846499ms since last change, 131.542318ms since last push, full=true 2026-07-24T19:29:29.351692Z info ads XDS: Pushing Services:115 ConnectedEndpoints:6 Version:2026-07-24T19:29:29Z/538 2026-07-24T19:29:29.353112Z info delta CDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:149 removed:2 size:171.7kB cached:146/146 2026-07-24T19:29:29.353231Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:149 removed:2 size:171.7kB cached:146/146 2026-07-24T19:29:29.353277Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:149 removed:2 size:171.7kB cached:146/146 2026-07-24T19:29:29.353270Z info delta CDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:149 removed:2 size:171.7kB cached:146/146 2026-07-24T19:29:29.353558Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:147 removed:2 size:171.2kB cached:146/146 2026-07-24T19:29:29.354081Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T19:29:29.354127Z info delta CDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:147 removed:3 size:171.2kB cached:146/146 2026-07-24T19:29:29.354486Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:29.354659Z info delta EDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T19:29:29.354710Z info delta EDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T19:29:29.354826Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:29.354888Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T19:29:29.354953Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:29.355040Z info delta LDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:29.355223Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:29:29.355335Z info delta RDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:3.7kB cached:0/0 2026-07-24T19:29:29.354905Z info delta SDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:29.355552Z info delta EDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T19:29:29.355644Z info delta LDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:0 removed:1 size:0B 2026-07-24T19:29:29.354113Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:148 removed:0 size:35.7kB empty:2 cached:146/148 2026-07-24T19:29:29.355573Z info delta SDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:29.355739Z warn buildGatewayRoutes: no gateways for router e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress 2026-07-24T19:29:29.355827Z info delta RDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:1 removed:0 size:94B cached:0/0 2026-07-24T19:29:29.355896Z warn ads proxy e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress attempted to access unauthorized certificates e2e-ipp-a-2d5d53-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-24T19:29:29.355977Z info delta ECDS: PUSH for node:e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T19:29:29.356003Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:29.355275Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:29.356418Z info delta SDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:29.356483Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:29.356515Z info delta ECDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:29.355432Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:29:29.356647Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T19:29:29.357226Z info delta ECDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:29.357405Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:29:29.357450Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:29.367237Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:29:34.061369Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T19:29:34.273445Z info delta ADS: "10.134.0.65:42912" e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k.openshift-ingress-32 terminated 2026-07-24T19:29:40.235542Z info model Incremental push, service maas-api-e2e-ipp-b-8a409a.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:29:40.306140Z info model Incremental push, service payload-processing-e2e-ipp-b-8a409a.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:29:40.321652Z info model Incremental push, service payload-pre-processing-e2e-ipp-b-8a409a.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:29:40.469807Z info ads Push debounce stable[953] 13 for config DestinationRule/openshift-ingress/maas-api-backend-tls-e2e-ipp-b-8a409a and 9 more configs: 100.227304ms since last change, 241.101585ms since last push, full=true 2026-07-24T19:29:40.470592Z info ads XDS: Pushing Services:112 ConnectedEndpoints:5 Version:2026-07-24T19:29:40Z/539 2026-07-24T19:29:40.471961Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:146 removed:3 size:168.1kB cached:143/143 2026-07-24T19:29:40.472152Z info delta CDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:146 removed:3 size:168.1kB cached:143/143 2026-07-24T19:29:40.471964Z info delta CDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:146 removed:3 size:168.1kB cached:143/143 2026-07-24T19:29:40.472025Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:146 removed:3 size:168.1kB cached:143/143 2026-07-24T19:29:40.472200Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:144 removed:3 size:167.7kB cached:143/143 2026-07-24T19:29:40.473030Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:146 removed:0 size:35.0kB empty:3 cached:143/146 2026-07-24T19:29:40.473082Z info delta EDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:146 removed:0 size:35.0kB empty:3 cached:143/146 2026-07-24T19:29:40.473438Z info delta EDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:146 removed:0 size:35.0kB empty:3 cached:143/146 2026-07-24T19:29:40.473538Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:40.473643Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:146 removed:0 size:35.0kB empty:3 cached:143/146 2026-07-24T19:29:40.473711Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:40.473682Z info delta LDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T19:29:40.473957Z warn constructed http route config for route https.443.default.e2e-ipp-b-8a409a-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:29:40.474065Z info delta RDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T19:29:40.474130Z info delta SDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:40.474468Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:146 removed:0 size:35.0kB empty:3 cached:143/146 2026-07-24T19:29:40.474068Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:40.474769Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:29:40.474858Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:40.474906Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:29:40.474945Z info delta SDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:40.474982Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T19:29:40.474062Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:40.475071Z info delta SDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:40.475112Z info delta ECDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:40.475347Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:29:40.475433Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:40.475903Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:40.475945Z info delta ECDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:40.482423Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:29:43.579684Z info ads Push debounce stable[954] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-ipp-b-8a409a: 100.902391ms since last change, 100.902318ms since last push, full=true 2026-07-24T19:29:43.579917Z info ads XDS: Pushing Services:112 ConnectedEndpoints:5 Version:2026-07-24T19:29:43Z/540 2026-07-24T19:29:43.581085Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:144 removed:0 size:167.7kB cached:143/143 2026-07-24T19:29:43.581298Z info delta CDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:146 removed:0 size:168.1kB cached:143/143 2026-07-24T19:29:43.581418Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:146 removed:0 size:168.1kB cached:143/143 2026-07-24T19:29:43.581422Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:146 removed:0 size:168.1kB cached:143/143 2026-07-24T19:29:43.581513Z info delta CDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:145 removed:1 size:168.0kB cached:141/143 2026-07-24T19:29:43.582207Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:143 removed:0 size:34.8kB empty:0 cached:143/143 2026-07-24T19:29:43.582227Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:143 removed:0 size:34.8kB empty:0 cached:143/143 2026-07-24T19:29:43.582577Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:43.582777Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:143 removed:0 size:34.8kB empty:0 cached:143/143 2026-07-24T19:29:43.582829Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:29:43.582950Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:29:43.583034Z info delta EDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:143 removed:0 size:34.8kB empty:0 cached:143/143 2026-07-24T19:29:43.583042Z info delta EDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:143 removed:0 size:34.8kB empty:0 cached:143/143 2026-07-24T19:29:43.583071Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:43.583223Z info delta LDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T19:29:43.583250Z warn constructed http route config for route https.443.default.e2e-ipp-b-8a409a-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:29:43.583274Z info delta RDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T19:29:43.583315Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:43.583335Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:43.583682Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:43.584068Z info delta ECDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:43.584226Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:29:43.584321Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:43.584601Z info delta ECDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:43.591246Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:29:44.061418Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T19:29:44.175035Z info ads Push debounce stable[955] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-ipp-b-8a409a: 100.740345ms since last change, 100.74028ms since last push, full=true 2026-07-24T19:29:44.185353Z info ads XDS: Pushing Services:112 ConnectedEndpoints:5 Version:2026-07-24T19:29:44Z/541 2026-07-24T19:29:44.185695Z info delta LDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T19:29:44.185716Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:44.185754Z info delta ECDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T19:29:44.185697Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:29:44.185779Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:44.185716Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:44.186325Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:44.186462Z info delta ECDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:44.193486Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:29:50.165453Z info ads Push debounce stable[956] 1 for config ConfigMap/ai-tenant-e2e-ipp-b-8a409a/kube-root-ca.crt: 100.444861ms since last change, 100.444801ms since last push, full=false 2026-07-24T19:29:50.165511Z info ads XDS: Incremental Pushing ConnectedEndpoints:5 Version:2026-07-24T19:29:44Z/541 2026-07-24T19:29:50.777713Z info ads Push debounce stable[957] 3 for config Secret/ai-tenant-e2e-ipp-b-8a409a/builder-dockercfg-28txr and 2 more configs: 100.230237ms since last change, 106.145285ms since last push, full=false 2026-07-24T19:29:50.777770Z info ads XDS: Incremental Pushing ConnectedEndpoints:5 Version:2026-07-24T19:29:44Z/541 2026-07-24T19:29:51.166905Z info ads Push debounce stable[958] 1 for config Gateway/openshift-ingress/e2e-ipp-b-8a409a-istio-autogenerated-k8s-gateway-https: 100.230089ms since last change, 100.230027ms since last push, full=true 2026-07-24T19:29:51.167032Z info ads XDS: Pushing Services:112 ConnectedEndpoints:5 Version:2026-07-24T19:29:51Z/542 2026-07-24T19:29:51.167440Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:51.167447Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:51.167461Z info delta LDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T19:29:51.167481Z warn constructed http route config for route https.443.default.e2e-ipp-b-8a409a-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:29:51.167520Z info delta RDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:122B cached:0/0 2026-07-24T19:29:51.167447Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:51.167447Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:29:51.167719Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:51.167747Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:29:51.167730Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:51.169311Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:29:51.322042Z info model Incremental push, service e2e-ipp-b-8a409a-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:29:51.422317Z info ads Push debounce stable[959] 6 for config Gateway/openshift-ingress/e2e-ipp-b-8a409a-istio-autogenerated-k8s-gateway-https and 4 more configs: 100.163272ms since last change, 118.491192ms since last push, full=true 2026-07-24T19:29:51.423113Z info ads XDS: Pushing Services:111 ConnectedEndpoints:5 Version:2026-07-24T19:29:51Z/543 2026-07-24T19:29:51.424537Z info delta CDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:144 removed:2 size:165.5kB cached:141/141 2026-07-24T19:29:51.424567Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:142 removed:2 size:165.1kB cached:141/141 2026-07-24T19:29:51.424714Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:144 removed:2 size:165.5kB cached:141/141 2026-07-24T19:29:51.424799Z info delta CDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:142 removed:3 size:165.1kB cached:141/141 2026-07-24T19:29:51.424847Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:144 removed:2 size:165.5kB cached:141/141 2026-07-24T19:29:51.425306Z info delta EDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:143 removed:0 size:34.4kB empty:2 cached:141/143 2026-07-24T19:29:51.425699Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:143 removed:0 size:34.4kB empty:2 cached:141/143 2026-07-24T19:29:51.425840Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:143 removed:0 size:34.4kB empty:2 cached:141/143 2026-07-24T19:29:51.426053Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:29:51.425724Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:51.426168Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:51.426231Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:29:51.426302Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T19:29:51.426308Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:143 removed:0 size:34.4kB empty:2 cached:141/143 2026-07-24T19:29:51.426422Z info delta EDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:143 removed:0 size:34.4kB empty:2 cached:141/143 2026-07-24T19:29:51.426502Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:51.426635Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:29:51.426515Z info delta LDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:0 removed:1 size:0B 2026-07-24T19:29:51.426824Z warn buildGatewayRoutes: no gateways for router e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress 2026-07-24T19:29:51.426659Z info delta SDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:51.426894Z info delta RDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:1 removed:0 size:94B cached:0/0 2026-07-24T19:29:51.426913Z warn ads proxy e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress attempted to access unauthorized certificates e2e-ipp-b-8a409a-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-24T19:29:51.426937Z info delta ECDS: PUSH for node:e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T19:29:51.427146Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:29:51.427188Z info delta SDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:51.427574Z info delta ECDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:51.427863Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:29:51.427909Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:29:51.427979Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:29:51.439862Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:29:54.061740Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T19:29:56.339114Z info delta ADS: "10.134.0.66:52358" e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28.openshift-ingress-33 terminated 2026-07-24T19:30:02.323482Z info model Incremental push, service maas-api-e2e-shared-a-65184f.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:30:02.391184Z info model Incremental push, service payload-processing-e2e-shared-a-65184f.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:30:02.405213Z info model Full push, new service openshift-ingress/payload-pre-processing-e2e-shared-a-65184f.openshift-ingress.svc.cluster.local 2026-07-24T19:30:02.412203Z info model Incremental push, service payload-pre-processing-e2e-shared-a-65184f.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:30:02.544918Z info ads Push debounce stable[960] 14 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~e2e-shared-a-65184f-istio-autogenerated-k8s-gateway-https~* and 9 more configs: 100.442933ms since last change, 240.322859ms since last push, full=true 2026-07-24T19:30:02.545695Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-24T19:30:02Z/544 2026-07-24T19:30:02.547242Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:141 removed:3 size:162.0kB cached:138/138 2026-07-24T19:30:02.547262Z info delta CDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:141 removed:3 size:162.0kB cached:138/138 2026-07-24T19:30:02.547240Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:141 removed:3 size:162.0kB cached:138/138 2026-07-24T19:30:02.547369Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:139 removed:3 size:161.5kB cached:138/138 2026-07-24T19:30:02.548115Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:141 removed:0 size:33.7kB empty:3 cached:138/141 2026-07-24T19:30:02.548350Z info delta EDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:141 removed:0 size:33.7kB empty:3 cached:138/141 2026-07-24T19:30:02.548472Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:141 removed:0 size:33.7kB empty:3 cached:138/141 2026-07-24T19:30:02.548547Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:02.548626Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:141 removed:0 size:33.7kB empty:3 cached:138/141 2026-07-24T19:30:02.548677Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T19:30:02.548750Z warn constructed http route config for route https.443.default.e2e-shared-a-65184f-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:30:02.548722Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:30:02.548808Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T19:30:02.548952Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:02.548969Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:30:02.549158Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T19:30:02.548978Z info delta SDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:30:02.549249Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:30:02.549319Z info delta SDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:30:02.550074Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:30:02.550208Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:30:02.550304Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:30:02.550396Z info delta ECDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:30:02.562493Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:30:04.061670Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T19:30:05.876283Z info ads Push debounce stable[961] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-shared-a-65184f: 100.663378ms since last change, 100.66331ms since last push, full=true 2026-07-24T19:30:05.876548Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-24T19:30:05Z/545 2026-07-24T19:30:05.877430Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:141 removed:0 size:162.0kB cached:138/138 2026-07-24T19:30:05.877567Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:139 removed:0 size:161.5kB cached:138/138 2026-07-24T19:30:05.877432Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:141 removed:0 size:162.0kB cached:138/138 2026-07-24T19:30:05.878015Z info delta CDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:140 removed:1 size:161.8kB cached:131/138 2026-07-24T19:30:05.878560Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:138/138 2026-07-24T19:30:05.878698Z info delta EDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:138/138 2026-07-24T19:30:05.878561Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:138/138 2026-07-24T19:30:05.878733Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:138/138 2026-07-24T19:30:05.878861Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:30:05.878940Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:05.878961Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T19:30:05.878972Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:30:05.878995Z warn constructed http route config for route https.443.default.e2e-shared-a-65184f-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:30:05.879010Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:05.879023Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T19:30:05.879337Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:30:05.879944Z info delta ECDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:30:05.880048Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:30:05.880058Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:30:05.886599Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:30:06.176260Z info ads Push debounce stable[962] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-65184f: 100.219733ms since last change, 100.219648ms since last push, full=true 2026-07-24T19:30:06.186025Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-24T19:30:06Z/546 2026-07-24T19:30:06.186359Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:06.186362Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:30:06.186407Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:06.186438Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T19:30:06.186490Z info delta ECDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T19:30:06.187137Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:30:06.193814Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:30:12.728295Z info ads Push debounce stable[963] 3 for config Secret/ai-tenant-e2e-shared-a-65184f/builder-dockercfg-9wkdq and 2 more configs: 100.24688ms since last change, 103.71989ms since last push, full=false 2026-07-24T19:30:12.728398Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-24T19:30:06Z/546 2026-07-24T19:30:13.332420Z info ads Push debounce stable[964] 1 for config ConfigMap/ai-tenant-e2e-shared-a-65184f/kube-root-ca.crt: 100.786269ms since last change, 100.786194ms since last push, full=false 2026-07-24T19:30:13.332502Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-24T19:30:06Z/546 2026-07-24T19:30:13.489895Z info ads Push debounce stable[965] 1 for config Gateway/openshift-ingress/e2e-shared-a-65184f-istio-autogenerated-k8s-gateway-https: 100.232899ms since last change, 100.232831ms since last push, full=true 2026-07-24T19:30:13.490037Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-24T19:30:13Z/547 2026-07-24T19:30:13.490412Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:13.490427Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:13.490467Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:30:13.490412Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T19:30:13.490583Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:30:13.490603Z warn constructed http route config for route https.443.default.e2e-shared-a-65184f-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:30:13.490703Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:30:13.490707Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T19:30:13.491599Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:30:13.656234Z info model Incremental push, service e2e-shared-a-65184f-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:30:13.757911Z info ads Push debounce stable[966] 6 for config EnvoyFilter/openshift-ingress/e2e-shared-a-65184f-authn-ssl and 4 more configs: 100.232605ms since last change, 125.688206ms since last push, full=true 2026-07-24T19:30:13.758653Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-24T19:30:13Z/548 2026-07-24T19:30:13.759686Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:137 removed:2 size:158.9kB cached:136/136 2026-07-24T19:30:13.759818Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:139 removed:2 size:159.3kB cached:136/136 2026-07-24T19:30:13.759905Z info delta CDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:137 removed:3 size:158.9kB cached:136/136 2026-07-24T19:30:13.760044Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:139 removed:2 size:159.3kB cached:136/136 2026-07-24T19:30:13.760779Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:138 removed:0 size:33.0kB empty:2 cached:136/138 2026-07-24T19:30:13.760977Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:138 removed:0 size:33.0kB empty:2 cached:136/138 2026-07-24T19:30:13.761037Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:138 removed:0 size:33.0kB empty:2 cached:136/138 2026-07-24T19:30:13.761215Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:30:13.761290Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:13.761506Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:30:13.761294Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:13.761556Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T19:30:13.761612Z info delta EDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:138 removed:0 size:33.0kB empty:2 cached:136/138 2026-07-24T19:30:13.761653Z info delta LDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:0 removed:1 size:0B 2026-07-24T19:30:13.761665Z warn buildGatewayRoutes: no gateways for router e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress 2026-07-24T19:30:13.761684Z info delta RDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-24T19:30:13.761705Z warn ads proxy e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress attempted to access unauthorized certificates e2e-shared-a-65184f-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-24T19:30:13.761736Z info delta ECDS: PUSH for node:e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T19:30:13.761827Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-24T19:30:13.761862Z info delta SDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:30:13.762588Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:30:13.762780Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:30:13.762819Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:30:13.769404Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:30:14.061961Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-24T19:30:18.678071Z info delta ADS: "10.134.0.58:51070" e2e-shared-a-65184f-openshift-default-546fc96b76-fng27.openshift-ingress-27 terminated 2026-07-24T19:30:25.339540Z info model Incremental push, service maas-api-e2e-shared-b-d391c5.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:30:25.413343Z info model Incremental push, service payload-processing-e2e-shared-b-d391c5.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:30:25.423862Z info model Full push, new service openshift-ingress/payload-pre-processing-e2e-shared-b-d391c5.openshift-ingress.svc.cluster.local 2026-07-24T19:30:25.434295Z info model Incremental push, service payload-pre-processing-e2e-shared-b-d391c5.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:30:25.574844Z info ads Push debounce stable[967] 14 for config Secret/odh-ai-gateway-infra/maas-api-e2e-shared-b-d391c5-serving-cert and 9 more configs: 100.188897ms since last change, 240.998878ms since last push, full=true 2026-07-24T19:30:25.575595Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-24T19:30:25Z/549 2026-07-24T19:30:25.577117Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:136 removed:3 size:155.8kB cached:133/133 2026-07-24T19:30:25.577239Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:134 removed:3 size:155.3kB cached:133/133 2026-07-24T19:30:25.577262Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:136 removed:3 size:155.8kB cached:133/133 2026-07-24T19:30:25.577851Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:136 removed:0 size:32.3kB empty:3 cached:133/136 2026-07-24T19:30:25.578035Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:136 removed:0 size:32.3kB empty:3 cached:133/136 2026-07-24T19:30:25.578211Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:25.578294Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T19:30:25.578400Z warn constructed http route config for route https.443.default.e2e-shared-b-d391c5-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:30:25.578485Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T19:30:25.578334Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:136 removed:0 size:32.3kB empty:3 cached:133/136 2026-07-24T19:30:25.578553Z info delta SDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:30:25.578906Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:30:25.579044Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:30:25.579121Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T19:30:25.579525Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:30:25.579848Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:30:25.579899Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:30:25.587666Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:30:28.278498Z info ads Push debounce stable[968] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-shared-b-d391c5: 100.656501ms since last change, 100.656434ms since last push, full=true 2026-07-24T19:30:28.278744Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-24T19:30:28Z/550 2026-07-24T19:30:28.279619Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:134 removed:0 size:155.3kB cached:133/133 2026-07-24T19:30:28.279639Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:136 removed:0 size:155.8kB cached:133/133 2026-07-24T19:30:28.279755Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:135 removed:1 size:155.6kB cached:131/133 2026-07-24T19:30:28.280349Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-24T19:30:28.280507Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-24T19:30:28.280639Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-24T19:30:28.280657Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:30:28.280721Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-24T19:30:28.280749Z warn constructed http route config for route https.443.default.e2e-shared-b-d391c5-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:30:28.280778Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T19:30:28.280785Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:30:28.280874Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:28.281313Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:7.3kB 2026-07-24T19:30:28.281844Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:30:28.288797Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:30:28.690645Z info ads Push debounce stable[969] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-d391c5: 100.219085ms since last change, 100.219035ms since last push, full=true 2026-07-24T19:30:28.700001Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-24T19:30:28Z/551 2026-07-24T19:30:28.700362Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:30:28.700400Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:28.700402Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T19:30:28.700556Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T19:30:28.706891Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:30:35.269564Z info ads Push debounce stable[970] 1 for config ConfigMap/ai-tenant-e2e-shared-b-d391c5/kube-root-ca.crt: 100.654005ms since last change, 100.653929ms since last push, full=false 2026-07-24T19:30:35.269608Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-24T19:30:28Z/551 2026-07-24T19:30:35.493597Z info ads Push debounce stable[971] 3 for config Secret/ai-tenant-e2e-shared-b-d391c5/builder-dockercfg-wvjcs and 2 more configs: 100.674511ms since last change, 109.033508ms since last push, full=false 2026-07-24T19:30:35.493682Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-24T19:30:28Z/551 2026-07-24T19:30:35.721153Z info ads Push debounce stable[972] 1 for config Gateway/openshift-ingress/e2e-shared-b-d391c5-istio-autogenerated-k8s-gateway-https: 100.234018ms since last change, 100.23395ms since last push, full=true 2026-07-24T19:30:35.721293Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-24T19:30:35Z/552 2026-07-24T19:30:35.721665Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-24T19:30:35.721677Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:35.721691Z warn constructed http route config for route https.443.default.e2e-shared-b-d391c5-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-24T19:30:35.721720Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-24T19:30:35.721762Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:30:35.721863Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:30:35.722788Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:30:35.886028Z info model Incremental push, service e2e-shared-b-d391c5-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-24T19:30:35.996682Z info ads Push debounce stable[973] 6 for config Gateway/openshift-ingress/e2e-shared-b-d391c5-istio-autogenerated-k8s-gateway-https and 4 more configs: 100.065642ms since last change, 146.56221ms since last push, full=true 2026-07-24T19:30:35.997350Z info ads XDS: Pushing Services:103 ConnectedEndpoints:3 Version:2026-07-24T19:30:35Z/553 2026-07-24T19:30:35.998684Z info delta CDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:132 removed:3 size:152.7kB cached:131/131 2026-07-24T19:30:35.998791Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:132 removed:2 size:152.7kB cached:131/131 2026-07-24T19:30:35.998861Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:134 removed:2 size:153.1kB cached:131/131 2026-07-24T19:30:35.999836Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-24T19:30:36.000005Z info delta EDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-24T19:30:36.000051Z info delta LDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:0 removed:1 size:0B 2026-07-24T19:30:36.000065Z warn buildGatewayRoutes: no gateways for router e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress 2026-07-24T19:30:36.000088Z info delta RDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-24T19:30:36.000107Z warn ads proxy e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress attempted to access unauthorized certificates e2e-shared-b-d391c5-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-24T19:30:36.000127Z info delta ECDS: PUSH for node:e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress resources:0 removed:0 size:0B 2026-07-24T19:30:36.000460Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-24T19:30:36.000786Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-24T19:30:36.001033Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-24T19:30:36.001193Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-24T19:30:36.001272Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-24T19:30:36.001753Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:52.8kB cached:0/0 2026-07-24T19:30:36.001792Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-24T19:30:36.008344Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress resources:1 removed:0 size:135.7kB 2026-07-24T19:30:40.917867Z info delta ADS: "10.133.0.53:36910" e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5.openshift-ingress-28 terminated 2026-07-24T19:30:44.061609Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-fcmm9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } }