2026-07-15T14:15:21.557801Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:15:21.557851Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:138 removed:0 size:33.2kB empty:0 cached:138/138 2026-07-15T14:15:21.558069Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:15:21.558146Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:15:21.558162Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:15:21.558370Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0 2026-07-15T14:15:21.558528Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:15:21.559964Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:30.5kB 2026-07-15T14:15:21.564590Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:15:22.121697Z info ads Push debounce stable[776] 4 for config Secret/odh-ai-gateway-infra/maas-api-dockercfg-tqpmm and 3 more configs: 100.96904ms since last change, 106.801351ms since last push, full=false 2026-07-15T14:15:22.121780Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:15:21Z/402 2026-07-15T14:15:22.143311Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-15T14:15:29.672582Z info ads Push debounce stable[777] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.184704ms since last change, 190.018858ms since last push, full=true 2026-07-15T14:15:29.673973Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-15T14:15:29Z/403 2026-07-15T14:15:29.675417Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:141 removed:0 size:162.1kB cached:135/138 2026-07-15T14:15:29.675447Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:141 removed:0 size:162.1kB cached:135/138 2026-07-15T14:15:29.675791Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:139 removed:0 size:161.6kB cached:135/138 2026-07-15T14:15:29.675832Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:141 removed:0 size:162.1kB cached:135/138 2026-07-15T14:15:29.676361Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:137/138 2026-07-15T14:15:29.676553Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:138/138 2026-07-15T14:15:29.676624Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:15:29.676788Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:15:29.676806Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:137/138 2026-07-15T14:15:29.676878Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:15:29.676788Z info delta EDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:138 removed:0 size:33.4kB empty:0 cached:138/138 2026-07-15T14:15:29.677074Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:15:29.677077Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:15:29.677387Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-15T14:15:29.677541Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-15T14:15:29.677869Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:15:29.678080Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:15:29.680243Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:30.5kB 2026-07-15T14:15:29.685158Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:15:32.143188Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-15T14:15:33.121577Z info ads Push debounce stable[778] 3 for config Secret/llm/builder-dockercfg-grf5x and 2 more configs: 100.330828ms since last change, 104.62784ms since last push, full=false 2026-07-15T14:15:33.121645Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:15:29Z/403 2026-07-15T14:15:37.536952Z info ads Push debounce stable[779] 1 for config Secret/ai-tenant-e2e-shared-a-2723e9/rate-test-model-2723e9-kserve-self-signed-certs: 100.889081ms since last change, 100.88898ms since last push, full=false 2026-07-15T14:15:37.537016Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:15:29Z/403 2026-07-15T14:15:39.126524Z info ads Push debounce stable[780] 1 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-d7lpf: 100.271464ms since last change, 100.27138ms since last push, full=false 2026-07-15T14:15:39.126594Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:15:29Z/403 2026-07-15T14:15:56.135110Z info ads Push debounce stable[781] 1 for config Secret/ai-tenant-e2e-shared-a-2723e9/rate-test-model-2723e9-kserve-self-signed-certs: 100.222966ms since last change, 100.222901ms since last push, full=false 2026-07-15T14:15:56.135164Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:15:29Z/403 2026-07-15T14:15:59.174319Z info model Incremental push, service rate-test-model-bfdd40-kserve-workload-svc.ai-tenant-e2e-shared-b-bfdd40.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-15T14:15:59.291330Z info ads Push debounce stable[782] 4 for config ServiceEntry/ai-tenant-e2e-shared-b-bfdd40/rate-test-model-bfdd40-kserve-workload-svc.ai-tenant-e2e-shared-b-bfdd40.svc.cluster.local and 2 more configs: 100.547129ms since last change, 156.195979ms since last push, full=true 2026-07-15T14:15:59.291919Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-15T14:15:59Z/404 2026-07-15T14:15:59.292501Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:4 removed:0 size:2.0kB cached:0/1 2026-07-15T14:15:59.292664Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:4 removed:0 size:2.0kB cached:0/1 2026-07-15T14:15:59.292697Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:2 removed:0 size:1.5kB cached:0/1 2026-07-15T14:15:59.292787Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:15:59.292664Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:4 removed:0 size:2.0kB cached:0/1 2026-07-15T14:15:59.292925Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:15:59.292925Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:15:59.293154Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:15:59.293084Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-15T14:15:59.293293Z info delta SDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:15:59.293217Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:15:59.293348Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-15T14:15:59.293569Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0 2026-07-15T14:15:59.293606Z info delta SDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:15:59.294233Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:15:59.294291Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:15:59.298390Z info delta EDS: PUSH request for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:107B empty:1 cached:0/1 filtered:138 2026-07-15T14:15:59.298834Z info delta EDS: PUSH request for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 filtered:138 2026-07-15T14:15:59.299454Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 filtered:138 2026-07-15T14:15:59.300971Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 filtered:138 2026-07-15T14:15:59.523908Z info ads Push debounce stable[783] 1 for config DestinationRule/ai-tenant-e2e-shared-b-bfdd40/rate-test-model-bfdd40-kserve-workload-svc: 100.213552ms since last change, 100.2135ms since last push, full=true 2026-07-15T14:15:59.524104Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-15T14:15:59Z/405 2026-07-15T14:15:59.524677Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-15T14:15:59.524702Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-07-15T14:15:59.524809Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-15T14:15:59.524907Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-15T14:15:59.525495Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:139 removed:0 size:33.5kB empty:0 cached:139/139 2026-07-15T14:15:59.525504Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-15T14:15:59.525557Z info delta EDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:139 removed:0 size:33.5kB empty:0 cached:139/139 2026-07-15T14:15:59.525673Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:139 removed:0 size:33.5kB empty:0 cached:139/139 2026-07-15T14:15:59.525766Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:15:59.525812Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:15:59.525742Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:15:59.526081Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:15:59.526092Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-15T14:15:59.526192Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:15:59.526345Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0 2026-07-15T14:15:59.527014Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:15:59.750995Z info ads Push debounce stable[784] 2 for config Secret/ai-tenant-e2e-shared-b-bfdd40/kserve-metrics-reader-sa-dockercfg-fdknv: 100.749178ms since last change, 116.162768ms since last push, full=false 2026-07-15T14:15:59.751072Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:15:59Z/405 2026-07-15T14:16:00.545106Z info model Full push, new service ai-tenant-e2e-shared-b-bfdd40/rate-test-model-bfdd40-kserve-workload-svc.ai-tenant-e2e-shared-b-bfdd40.svc.cluster.local 2026-07-15T14:16:00.645385Z info ads Push debounce stable[785] 1 for config ServiceEntry/ai-tenant-e2e-shared-b-bfdd40/rate-test-model-bfdd40-kserve-workload-svc.ai-tenant-e2e-shared-b-bfdd40.svc.cluster.local: 100.221767ms since last change, 100.221715ms since last push, full=true 2026-07-15T14:16:00.645942Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-15T14:16:00Z/406 2026-07-15T14:16:00.646600Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-07-15T14:16:00.646659Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-15T14:16:00.646668Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:107B empty:1 cached:0/1 2026-07-15T14:16:00.646720Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-15T14:16:00.646786Z info delta EDS: PUSH INC for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 2026-07-15T14:16:00.646599Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-15T14:16:00.646723Z info delta EDS: PUSH INC for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 2026-07-15T14:16:00.646901Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 2026-07-15T14:16:00.646923Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:16:00.647014Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:16:00.647079Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:00.647017Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:16:00.647090Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:00.647382Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0 2026-07-15T14:16:00.647766Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0 2026-07-15T14:16:00.648196Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:16:02.143410Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||rate-test-model-bfdd40-kserve-workload-svc.ai-tenant-e2e-shared-b-bfdd40.svc.cluster.local": {} } } 2026-07-15T14:16:04.943405Z info ads Push debounce stable[786] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-bfdd40: 100.219673ms since last change, 100.219617ms since last push, full=true 2026-07-15T14:16:04.956116Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-15T14:16:04Z/407 2026-07-15T14:16:04.956479Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:04.956561Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:16:04.956479Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:16:04.956479Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:04.958173Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:30.5kB 2026-07-15T14:16:04.958189Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:30.5kB 2026-07-15T14:16:04.962947Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:16:09.702584Z info ads Push debounce stable[787] 1 for config ServiceEntry/ai-tenant-e2e-shared-b-bfdd40/rate-test-model-bfdd40-kserve-workload-svc.ai-tenant-e2e-shared-b-bfdd40.svc.cluster.local: 100.9455ms since last change, 100.945434ms since last push, full=false 2026-07-15T14:16:09.702652Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:16:04Z/407 2026-07-15T14:16:16.034311Z info ads Push debounce stable[788] 1 for config Secret/ai-tenant-e2e-shared-b-bfdd40/rate-test-model-bfdd40-kserve-self-signed-certs: 100.230433ms since last change, 100.230352ms since last push, full=false 2026-07-15T14:16:16.034370Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:16:04Z/407 2026-07-15T14:16:28.940597Z info ads Push debounce stable[789] 2 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-2723e9 and 1 more configs: 100.430003ms since last change, 197.231067ms since last push, full=true 2026-07-15T14:16:28.953341Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-15T14:16:28Z/408 2026-07-15T14:16:28.953661Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:16:28.953671Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:28.953671Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:28.953665Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:16:28.955157Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-15T14:16:28.955178Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-15T14:16:28.960347Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:16:44.541293Z info ads Push debounce stable[790] 2 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-2723e9 and 1 more configs: 100.4311ms since last change, 188.458799ms since last push, full=true 2026-07-15T14:16:44.558812Z info ads XDS: Pushing Services:109 ConnectedEndpoints:4 Version:2026-07-15T14:16:44Z/409 2026-07-15T14:16:44.559149Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:16:44.559154Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:44.559153Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:16:44.559154Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:44.560840Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-15T14:16:44.560948Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:31.8kB 2026-07-15T14:16:44.565797Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:16:49.982663Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 9dc259b6-5bca-4c58-b118-3c71646305e7 rate-test-model-2723e9-kserve-route ai-tenant-e2e-shared-a-2723e9 cluster.local map[app.kubernetes.io/component:llminferenceservice-router app.kubernetes.io/name:rate-test-model-2723e9 app.kubernetes.io/part-of:llminferenceservice] map[] 62633 2026-07-15 14:15:11 +0000 UTC [{serving.kserve.io/v1alpha2 LLMInferenceService rate-test-model-2723e9 9ee8fd57-080e-4d62-aa74-fc39ae84cb1b 0xc004f812fd 0xc004f812fc}] 1} 0xc004a7d008 0xc003376468 map[]}, will try again later: httproutes.gateway.networking.k8s.io "rate-test-model-2723e9-kserve-route" not found 2026-07-15T14:16:49.989323Z info model Incremental push, service rate-test-model-2723e9-kserve-workload-svc.ai-tenant-e2e-shared-a-2723e9.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-15T14:16:50.089544Z info ads Push debounce stable[791] 6 for config Secret/ai-tenant-e2e-shared-a-2723e9/kserve-metrics-reader-sa-dockercfg-p2w4d and 4 more configs: 100.183468ms since last change, 162.753898ms since last push, full=true 2026-07-15T14:16:50.090197Z info ads XDS: Pushing Services:108 ConnectedEndpoints:4 Version:2026-07-15T14:16:50Z/410 2026-07-15T14:16:50.090733Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:16:50.090794Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:1 size:44B 2026-07-15T14:16:50.090834Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:16:50.090935Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:16:50.091532Z info delta EDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-15T14:16:50.091654Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-15T14:16:50.091756Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-15T14:16:50.091795Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:139 removed:0 size:33.5kB empty:1 cached:138/139 2026-07-15T14:16:50.091828Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:50.091917Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:16:50.092031Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:16:50.092058Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-15T14:16:50.092078Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:50.092077Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:16:50.092114Z info delta SDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:16:50.092209Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-15T14:16:50.092422Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0 2026-07-15T14:16:50.092451Z info delta SDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:16:50.093105Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:16:50.093171Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:16:50.647259Z info ads Push debounce stable[792] 1 for config Secret/ai-tenant-e2e-shared-b-bfdd40/kserve-metrics-reader-sa-dockercfg-fdknv: 100.221224ms since last change, 100.221141ms since last push, full=false 2026-07-15T14:16:50.647341Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:16:50Z/410 2026-07-15T14:16:50.851111Z info model Incremental push, service rate-test-model-bfdd40-kserve-workload-svc.ai-tenant-e2e-shared-b-bfdd40.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-15T14:16:50.952038Z info ads Push debounce stable[793] 5 for config Secret/ai-tenant-e2e-shared-b-bfdd40/rate-test-model-bfdd40-kserve-self-signed-certs and 3 more configs: 100.779493ms since last change, 120.187393ms since last push, full=true 2026-07-15T14:16:50.952743Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-15T14:16:50Z/411 2026-07-15T14:16:50.953203Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:16:50.953349Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:16:50.953362Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:1 size:44B 2026-07-15T14:16:50.953487Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:16:50.954160Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:138 removed:0 size:33.2kB empty:1 cached:137/138 2026-07-15T14:16:50.954255Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:138 removed:0 size:33.2kB empty:1 cached:137/138 2026-07-15T14:16:50.954358Z info delta EDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:138 removed:0 size:33.2kB empty:1 cached:137/138 2026-07-15T14:16:50.954507Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:50.954357Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:138 removed:0 size:33.2kB empty:1 cached:137/138 2026-07-15T14:16:50.954613Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:50.954509Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:16:50.954761Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-15T14:16:50.954860Z info delta SDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:16:50.954782Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:16:50.954904Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-15T14:16:50.954935Z info delta SDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:16:50.954974Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:16:50.955008Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-15T14:16:50.955499Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:16:50.955532Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:16:52.143094Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-15T14:16:54.930256Z info ads Push debounce stable[794] 2 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-2723e9 and 1 more configs: 100.218116ms since last change, 186.028774ms since last push, full=true 2026-07-15T14:16:54.940750Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-15T14:16:54Z/412 2026-07-15T14:16:54.941098Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:16:54.941099Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:54.941103Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:16:54.941116Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:16:54.941894Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:16:54.941993Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:16:54.952087Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:17:10.040428Z info ads Push debounce stable[795] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.916673ms since last change, 180.736169ms since last push, full=true 2026-07-15T14:17:10.042148Z info ads XDS: Pushing Services:107 ConnectedEndpoints:4 Version:2026-07-15T14:17:10Z/413 2026-07-15T14:17:10.043534Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:140 removed:0 size:160.7kB cached:135/137 2026-07-15T14:17:10.043635Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:138 removed:0 size:160.3kB cached:135/137 2026-07-15T14:17:10.043896Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:140 removed:0 size:160.7kB cached:135/137 2026-07-15T14:17:10.044045Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:140 removed:0 size:160.7kB cached:135/137 2026-07-15T14:17:10.044356Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:136/137 2026-07-15T14:17:10.044450Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:136/137 2026-07-15T14:17:10.044611Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:10.044717Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:10.044770Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-15T14:17:10.044804Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:17:10.044719Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-15T14:17:10.044770Z info delta EDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:137 removed:0 size:33.1kB empty:0 cached:137/137 2026-07-15T14:17:10.045082Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:10.045180Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:17:10.045474Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-15T14:17:10.045595Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:17:10.046300Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:17:10.046409Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:17:10.053052Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:17:12.142999Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-15T14:17:19.864880Z info model Incremental push, service maas-api-e2e-shared-a-2723e9.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-15T14:17:19.994752Z info ads Push debounce stable[796] 5 for config DestinationRule/openshift-ingress/maas-api-backend-tls-e2e-shared-a-2723e9 and 3 more configs: 100.068526ms since last change, 141.838343ms since last push, full=true 2026-07-15T14:17:19.995397Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-15T14:17:19Z/414 2026-07-15T14:17:19.995833Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:1 size:44B 2026-07-15T14:17:19.995999Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:17:19.996028Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:17:19.996389Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:17:19.996860Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-15T14:17:19.996898Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-15T14:17:19.997002Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-15T14:17:19.997174Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:19.997231Z info delta EDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:137 removed:0 size:33.0kB empty:1 cached:136/137 2026-07-15T14:17:19.997234Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:19.997471Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:17:19.997498Z warn constructed http route config for route https.443.default.e2e-shared-a-2723e9-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-15T14:17:19.997473Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:17:19.997588Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-15T14:17:19.997548Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:19.997620Z info delta SDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:17:19.997619Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-15T14:17:19.997814Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-15T14:17:19.997843Z info delta SDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:17:19.998545Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:17:19.998580Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:17:22.143366Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-15T14:17:23.522629Z info ads Push debounce stable[797] 2 for config EnvoyFilter/openshift-ingress/kuadrant-auth-e2e-shared-a-2723e9 and 1 more configs: 100.944043ms since last change, 195.704478ms since last push, full=true 2026-07-15T14:17:23.522893Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-15T14:17:23Z/415 2026-07-15T14:17:23.523997Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:139 removed:0 size:159.6kB cached:136/136 2026-07-15T14:17:23.524027Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:137 removed:0 size:159.1kB cached:136/136 2026-07-15T14:17:23.524062Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:139 removed:0 size:159.6kB cached:136/136 2026-07-15T14:17:23.524395Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:138 removed:1 size:159.4kB cached:129/136 2026-07-15T14:17:23.524929Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-15T14:17:23.524962Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-15T14:17:23.525113Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-15T14:17:23.525174Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:23.525215Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:23.525377Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-15T14:17:23.525399Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:23.525510Z info delta EDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:136 removed:0 size:32.9kB empty:0 cached:136/136 2026-07-15T14:17:23.525525Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:17:23.525703Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:17:23.525725Z warn constructed http route config for route https.443.default.e2e-shared-a-2723e9-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-15T14:17:23.525752Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-15T14:17:23.525952Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:17:23.526217Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:17:23.526380Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:17:23.532248Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:17:23.826808Z info ads Push debounce stable[798] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-2723e9: 100.641848ms since last change, 100.641784ms since last push, full=true 2026-07-15T14:17:23.841650Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-15T14:17:23Z/416 2026-07-15T14:17:23.842009Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:23.842032Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:23.842039Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-15T14:17:23.842056Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:23.842076Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:0 removed:0 size:0B 2026-07-15T14:17:23.842903Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:17:23.849010Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:17:29.502835Z info ads Push debounce stable[799] 3 for config Secret/ai-tenant-e2e-shared-a-2723e9/builder-dockercfg-97pp8 and 2 more configs: 100.253172ms since last change, 114.429089ms since last push, full=false 2026-07-15T14:17:29.502907Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:17:23Z/416 2026-07-15T14:17:30.573608Z info ads Push debounce stable[800] 1 for config ConfigMap/ai-tenant-e2e-shared-a-2723e9/kube-root-ca.crt: 100.722182ms since last change, 100.722121ms since last push, full=false 2026-07-15T14:17:30.573686Z info ads XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-15T14:17:23Z/416 2026-07-15T14:17:31.080850Z info ads Push debounce stable[801] 1 for config Gateway/openshift-ingress/e2e-shared-a-2723e9-istio-autogenerated-k8s-gateway-https: 100.224848ms since last change, 100.22478ms since last push, full=true 2026-07-15T14:17:31.080969Z info ads XDS: Pushing Services:106 ConnectedEndpoints:4 Version:2026-07-15T14:17:31Z/417 2026-07-15T14:17:31.081313Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:31.081406Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:17:31.081318Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:31.081318Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-15T14:17:31.081524Z warn constructed http route config for route https.443.default.e2e-shared-a-2723e9-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-15T14:17:31.081555Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-15T14:17:31.081318Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:31.081608Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-15T14:17:31.082485Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:17:35.100888Z info model Incremental push, service e2e-shared-a-2723e9-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-15T14:17:35.205560Z info ads Push debounce stable[802] 6 for config Secret/openshift-ingress/e2e-shared-a-2723e9-gw-service-tls and 4 more configs: 100.243875ms since last change, 123.480216ms since last push, full=true 2026-07-15T14:17:35.206219Z info ads XDS: Pushing Services:105 ConnectedEndpoints:4 Version:2026-07-15T14:17:35Z/418 2026-07-15T14:17:35.207376Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:137 removed:2 size:156.9kB cached:134/134 2026-07-15T14:17:35.207419Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:137 removed:2 size:156.9kB cached:134/134 2026-07-15T14:17:35.207633Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:135 removed:2 size:156.5kB cached:134/134 2026-07-15T14:17:35.207726Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:135 removed:3 size:156.5kB cached:134/134 2026-07-15T14:17:35.207947Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-15T14:17:35.208319Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-15T14:17:35.208350Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:35.208386Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-15T14:17:35.208515Z info delta EDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:136 removed:0 size:32.5kB empty:2 cached:134/136 2026-07-15T14:17:35.208567Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:35.208579Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:35.208567Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:0 removed:1 size:0B 2026-07-15T14:17:35.208727Z warn buildGatewayRoutes: no gateways for router e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress 2026-07-15T14:17:35.208673Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:17:35.208760Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0 2026-07-15T14:17:35.208792Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-15T14:17:35.208794Z info delta SDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:17:35.208811Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-15T14:17:35.208916Z warn ads proxy e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress attempted to access unauthorized certificates e2e-shared-a-2723e9-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-15T14:17:35.208958Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:0 removed:0 size:0B 2026-07-15T14:17:35.209350Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:17:35.209384Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:17:35.209454Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:17:35.215679Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:17:36.270741Z info ads Push debounce stable[803] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.867522ms since last change, 195.544817ms since last push, full=true 2026-07-15T14:17:36.272227Z info ads XDS: Pushing Services:105 ConnectedEndpoints:4 Version:2026-07-15T14:17:36Z/419 2026-07-15T14:17:36.273433Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:135 removed:0 size:156.5kB cached:132/134 2026-07-15T14:17:36.273541Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:137 removed:0 size:156.9kB cached:132/134 2026-07-15T14:17:36.273438Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:137 removed:0 size:156.9kB cached:132/134 2026-07-15T14:17:36.273438Z info delta CDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:135 removed:0 size:156.5kB cached:134/134 2026-07-15T14:17:36.274318Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:133/134 2026-07-15T14:17:36.274411Z info delta EDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:133/134 2026-07-15T14:17:36.274452Z info delta LDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:0 removed:0 size:0B 2026-07-15T14:17:36.274465Z warn buildGatewayRoutes: no gateways for router e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress 2026-07-15T14:17:36.274483Z info delta RDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-15T14:17:36.274515Z info delta ECDS: PUSH for node:e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress resources:0 removed:0 size:0B 2026-07-15T14:17:36.274596Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:36.274678Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:134/134 2026-07-15T14:17:36.274692Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:17:36.274970Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:36.275129Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:134 removed:0 size:32.3kB empty:0 cached:134/134 2026-07-15T14:17:36.275446Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:17:36.275857Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0 2026-07-15T14:17:36.276372Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:17:36.276959Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:17:36.282729Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:17:40.125814Z info delta ADS: "10.134.0.41:48742" e2e-shared-a-2723e9-openshift-default-764b5cb8ff-bk8qd.openshift-ingress-28 terminated 2026-07-15T14:17:42.143329Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-15T14:17:45.119149Z info ads Push debounce stable[804] 4 for config Secret/premium-users-namespace/default-dockercfg-s8kt9 and 3 more configs: 100.225613ms since last change, 103.220183ms since last push, full=false 2026-07-15T14:17:45.119216Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-15T14:17:36Z/419 2026-07-15T14:17:46.128966Z info ads Push debounce stable[805] 4 for config Secret/maas-admin/tester-admin-user-dockercfg-9pr9f and 3 more configs: 100.296678ms since last change, 106.874623ms since last push, full=false 2026-07-15T14:17:46.129029Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-15T14:17:36Z/419 2026-07-15T14:17:46.230307Z info model Incremental push, service maas-api-e2e-shared-b-bfdd40.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-15T14:17:46.378380Z info ads Push debounce stable[806] 5 for config DestinationRule/openshift-ingress/maas-api-backend-tls-e2e-shared-b-bfdd40 and 3 more configs: 100.32233ms since last change, 167.628729ms since last push, full=true 2026-07-15T14:17:46.379008Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-15T14:17:46Z/420 2026-07-15T14:17:46.379470Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:17:46.379476Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:1 size:44B 2026-07-15T14:17:46.379652Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:3 removed:1 size:507B 2026-07-15T14:17:46.380197Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:134 removed:0 size:32.2kB empty:1 cached:133/134 2026-07-15T14:17:46.380443Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:134 removed:0 size:32.2kB empty:1 cached:133/134 2026-07-15T14:17:46.380586Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:17:46.380617Z warn constructed http route config for route https.443.default.e2e-shared-b-bfdd40-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-15T14:17:46.380662Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-15T14:17:46.380668Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:46.380705Z info delta SDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:17:46.380628Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:134 removed:0 size:32.2kB empty:1 cached:133/134 2026-07-15T14:17:46.380958Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:46.381041Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:17:46.381077Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-15T14:17:46.381672Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:17:46.381707Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:17:48.117685Z info ads Push debounce stable[807] 1 for config Secret/default/tester-regular-user-dockercfg-5pt2s: 100.955434ms since last change, 100.955382ms since last push, full=false 2026-07-15T14:17:48.117740Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-15T14:17:46Z/420 2026-07-15T14:17:49.429327Z info ads Push debounce stable[808] 1 for config EnvoyFilter/openshift-ingress/kuadrant-auth-e2e-shared-b-bfdd40: 100.881814ms since last change, 100.881539ms since last push, full=true 2026-07-15T14:17:49.429519Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-15T14:17:49Z/421 2026-07-15T14:17:49.430343Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:134 removed:0 size:155.3kB cached:133/133 2026-07-15T14:17:49.430672Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:136 removed:0 size:155.8kB cached:133/133 2026-07-15T14:17:49.430737Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:136 removed:0 size:155.8kB cached:131/133 2026-07-15T14:17:49.431127Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-15T14:17:49.431466Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:49.431595Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:17:49.431763Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-15T14:17:49.431874Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-15T14:17:49.432038Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:17:49.432070Z warn constructed http route config for route https.443.default.e2e-shared-b-bfdd40-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-15T14:17:49.432103Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-15T14:17:49.432135Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:49.432817Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:17:49.433030Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:17:49.439179Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:17:49.626906Z info ads Push debounce stable[809] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-shared-b-bfdd40: 100.18125ms since last change, 100.181198ms since last push, full=true 2026-07-15T14:17:49.627142Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-15T14:17:49Z/422 2026-07-15T14:17:49.628019Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:134 removed:0 size:155.3kB cached:133/133 2026-07-15T14:17:49.628145Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:136 removed:0 size:155.8kB cached:133/133 2026-07-15T14:17:49.628173Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:135 removed:1 size:155.6kB cached:129/133 2026-07-15T14:17:49.628877Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-15T14:17:49.628904Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-15T14:17:49.629049Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:133 removed:0 size:32.1kB empty:0 cached:133/133 2026-07-15T14:17:49.629162Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:4.6kB 2026-07-15T14:17:49.629184Z warn constructed http route config for route https.443.default.e2e-shared-b-bfdd40-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-15T14:17:49.629207Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-15T14:17:49.629240Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:49.629353Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:49.629435Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:17:49.629787Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:8.4kB 2026-07-15T14:17:49.630192Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:17:49.636382Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:17:49.925185Z info ads Push debounce stable[810] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-bfdd40: 100.230033ms since last change, 100.229981ms since last push, full=true 2026-07-15T14:17:49.934087Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-15T14:17:49Z/423 2026-07-15T14:17:49.934454Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-15T14:17:49.934506Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:0 removed:0 size:0B 2026-07-15T14:17:49.934454Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:49.934454Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:49.941064Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:17:55.932090Z info ads Push debounce stable[811] 3 for config Secret/ai-tenant-e2e-shared-b-bfdd40/builder-dockercfg-mn88l and 2 more configs: 100.27795ms since last change, 108.532911ms since last push, full=false 2026-07-15T14:17:55.932162Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-15T14:17:49Z/423 2026-07-15T14:17:56.343303Z info ads Push debounce stable[812] 1 for config ConfigMap/ai-tenant-e2e-shared-b-bfdd40/kube-root-ca.crt: 100.544665ms since last change, 100.544611ms since last push, full=false 2026-07-15T14:17:56.343354Z info ads XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-15T14:17:49Z/423 2026-07-15T14:17:57.160391Z info ads Push debounce stable[813] 1 for config Gateway/openshift-ingress/e2e-shared-b-bfdd40-istio-autogenerated-k8s-gateway-https: 100.591481ms since last change, 100.591412ms since last push, full=true 2026-07-15T14:17:57.160542Z info ads XDS: Pushing Services:104 ConnectedEndpoints:3 Version:2026-07-15T14:17:57Z/424 2026-07-15T14:17:57.160922Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-15T14:17:57.160965Z warn constructed http route config for route https.443.default.e2e-shared-b-bfdd40-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-15T14:17:57.161002Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-07-15T14:17:57.161441Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:17:57.161548Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:17:57.161869Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:17:57.163134Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:18:01.328903Z info model Incremental push, service e2e-shared-b-bfdd40-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-15T14:18:01.430449Z info ads Push debounce stable[814] 6 for config Secret/openshift-ingress/e2e-shared-b-bfdd40-openshift-default-dockercfg-w2znv and 4 more configs: 101.030696ms since last change, 123.428717ms since last push, full=true 2026-07-15T14:18:01.431115Z info ads XDS: Pushing Services:103 ConnectedEndpoints:3 Version:2026-07-15T14:18:01Z/425 2026-07-15T14:18:01.432258Z info delta CDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:132 removed:3 size:152.7kB cached:131/131 2026-07-15T14:18:01.432343Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:134 removed:2 size:153.1kB cached:131/131 2026-07-15T14:18:01.432393Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:132 removed:2 size:152.7kB cached:131/131 2026-07-15T14:18:01.432975Z info delta EDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-15T14:18:01.433051Z info delta LDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:0 removed:1 size:0B 2026-07-15T14:18:01.433069Z warn buildGatewayRoutes: no gateways for router e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress 2026-07-15T14:18:01.433088Z info delta RDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-07-15T14:18:01.433110Z warn ads proxy e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress attempted to access unauthorized certificates e2e-shared-b-bfdd40-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-07-15T14:18:01.433115Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-15T14:18:01.433136Z info delta ECDS: PUSH for node:e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress resources:0 removed:0 size:0B 2026-07-15T14:18:01.433332Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:133 removed:0 size:31.7kB empty:2 cached:131/133 2026-07-15T14:18:01.433373Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-15T14:18:01.433458Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-15T14:18:01.433491Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6576859cf495zfx.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-15T14:18:01.433557Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.1kB 2026-07-15T14:18:01.439949Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0 2026-07-15T14:18:01.439992Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-15T14:18:01.447585Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-15T14:18:02.143210Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-56654dcf7-nv52m.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-15T14:18:06.348285Z info delta ADS: "10.132.0.59:49796" e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25.openshift-ingress-29 terminated