2026-09-09T21:03:14.321695Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|5432||postgres.odh-ai-gateway-infra.svc.cluster.local": {} } } 2026-09-09T21:03:14.477487Z info ads Push debounce stable[74] 6 for config ServiceEntry/kuadrant-system/authorino-controller-metrics.kuadrant-system.svc.cluster.local and 2 more configs: 100.859678ms since last change, 138.089569ms since last push, full=false 2026-09-09T21:03:14.477541Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:03:05Z/44 2026-09-09T21:03:14.724658Z info ads Push debounce stable[75] 3 for config ServiceEntry/kuadrant-system/authorino-authorino-authorization.kuadrant-system.svc.cluster.local and 2 more configs: 100.222659ms since last change, 102.543806ms since last push, full=false 2026-09-09T21:03:14.724711Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:03:05Z/44 2026-09-09T21:03:19.015550Z info ads Push debounce stable[76] 2 for config Secret/opendatahub/maas-controller-dockercfg-qkvvl: 100.255356ms since last change, 113.649519ms since last push, full=false 2026-09-09T21:03:19.015627Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:03:05Z/44 2026-09-09T21:03:19.097319Z info model Incremental push, service maas-controller-metrics.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:03:19.115620Z info model Incremental push, service maas-controller-webhook-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:03:19.216090Z info ads Push debounce stable[77] 4 for config ServiceEntry/opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local and 1 more configs: 100.405833ms since last change, 125.766869ms since last push, full=true 2026-09-09T21:03:19.216834Z info ads XDS: Pushing Services:96 ConnectedEndpoints:2 Version:2026-09-09T21:03:19Z/45 2026-09-09T21:03:19.217481Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-09T21:03:19.217537Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:4 removed:0 size:2.5kB cached:0/2 2026-09-09T21:03:19.217735Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:03:19.217800Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T21:03:19.217821Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:03:19.217830Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T21:03:19.217856Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T21:03:19.221890Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 filtered:122 2026-09-09T21:03:19.222435Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:2 removed:0 size:147B empty:0 cached:2/2 filtered:122 2026-09-09T21:03:19.737644Z info ads Push debounce stable[78] 1 for config Secret/opendatahub/maas-controller-webhook-cert: 100.80604ms since last change, 100.80598ms since last push, full=false 2026-09-09T21:03:19.737698Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:03:19Z/45 2026-09-09T21:03:19.847608Z info ads Push debounce stable[79] 1 for config Secret/opendatahub/maas-controller-metrics-tls: 100.61383ms since last change, 100.613705ms since last push, full=false 2026-09-09T21:03:19.847661Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:03:19Z/45 2026-09-09T21:03:23.214717Z info ads Push debounce stable[80] 7 for config Secret/ai-tenants/deployer-dockercfg-k94gk and 3 more configs: 100.318754ms since last change, 148.963572ms since last push, full=false 2026-09-09T21:03:23.214792Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:03:19Z/45 2026-09-09T21:03:23.743827Z info model Full push, new service opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local 2026-09-09T21:03:23.743883Z info model Full push, new service opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local 2026-09-09T21:03:23.844736Z info ads Push debounce stable[81] 2 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.827625ms since last change, 100.830228ms since last push, full=true 2026-09-09T21:03:23.845224Z info ads XDS: Pushing Services:96 ConnectedEndpoints:2 Version:2026-09-09T21:03:23Z/46 2026-09-09T21:03:23.845738Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:4 removed:0 size:2.5kB cached:0/2 2026-09-09T21:03:23.845783Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-09T21:03:23.845813Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 2026-09-09T21:03:23.845851Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:147B empty:0 cached:2/2 2026-09-09T21:03:23.846017Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T21:03:23.846041Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T21:03:23.846067Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T21:03:23.846069Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:03:23.846177Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:03:24.321561Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {}, "outbound|8443||maas-controller-metrics.opendatahub.svc.cluster.local": {} } } 2026-09-09T21:03:34.827028Z info ads Push debounce stable[82] 2 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.747913ms since last change, 100.751414ms since last push, full=false 2026-09-09T21:03:34.827082Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:03:23Z/46 2026-09-09T21:03:34.958824Z info ads Push debounce stable[83] 4 for config ServiceEntry/opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local and 1 more configs: 100.270992ms since last change, 128.871611ms since last push, full=false 2026-09-09T21:03:34.958877Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:03:23Z/46 2026-09-09T21:03:35.236279Z info ads Push debounce stable[84] 2 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.275067ms since last change, 101.311584ms since last push, full=false 2026-09-09T21:03:35.236326Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:03:23Z/46 2026-09-09T21:03:54.895809Z info ads Push debounce stable[85] 7 for config ConfigMap/models-as-a-service/kube-root-ca.crt and 3 more configs: 100.883385ms since last change, 161.834451ms since last push, full=false 2026-09-09T21:03:54.895876Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:03:23Z/46 2026-09-09T21:03:56.273216Z info model Incremental push, service maas-api.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:03:56.294492Z info model Incremental push, service maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:03:56.496618Z info ads Push debounce stable[86] 8 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 3 more configs: 100.803392ms since last change, 230.392933ms since last push, full=true 2026-09-09T21:03:56.497166Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-09-09T21:03:56Z/47 2026-09-09T21:03:56.497824Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:3 removed:0 size:2.3kB cached:0/2 2026-09-09T21:03:56.497850Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:4 removed:0 size:2.7kB cached:0/2 2026-09-09T21:03:56.498102Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T21:03:56.498135Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T21:03:56.498103Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:03:56.498169Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T21:03:56.498224Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:03:56.498296Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:03:56.498334Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:03:56.504462Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 filtered:124 2026-09-09T21:03:56.504466Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 filtered:124 2026-09-09T21:03:56.759489Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:03:56.816170Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:03:57.098633Z info ads Push debounce stable[87] 16 for config EnvoyFilter/openshift-ingress/payload-processing and 12 more configs: 100.72944ms since last change, 586.32204ms since last push, full=true 2026-09-09T21:03:57.101652Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T21:03:57Z/48 2026-09-09T21:03:57.102996Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:129 removed:0 size:149.2kB cached:118/128 2026-09-09T21:03:57.103580Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:126 removed:0 size:29.8kB empty:1 cached:125/126 2026-09-09T21:03:57.103794Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:03:57.103865Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:03:57.103903Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:03:57.106147Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:132 removed:0 size:149.7kB cached:0/128 2026-09-09T21:03:57.106603Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:126 removed:0 size:29.8kB empty:0 cached:126/126 2026-09-09T21:03:57.106798Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:03:57.107013Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T21:03:57.107042Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:03:57.115615Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:126 2026-09-09T21:03:57.120276Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:126 2026-09-09T21:03:57.849807Z info ads Push debounce stable[88] 1 for config EnvoyFilter/openshift-ingress/payload-processing: 100.946403ms since last change, 100.946314ms since last push, full=true 2026-09-09T21:03:57.851053Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T21:03:57Z/49 2026-09-09T21:03:57.851920Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T21:03:57.852018Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:132 removed:0 size:149.7kB cached:128/128 2026-09-09T21:03:57.852641Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T21:03:57.852885Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T21:03:57.852936Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:03:57.853035Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:03:57.853157Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:03:57.853492Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T21:03:59.890914Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-09T21:03:59.910288Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-09T21:03:59.983894Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T21:03:59.983948Z info model Full push, new service odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T21:04:00.084206Z info ads Push debounce stable[89] 4 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 3 more configs: 100.232905ms since last change, 193.248689ms since last push, full=true 2026-09-09T21:04:00.084744Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T21:04:00Z/50 2026-09-09T21:04:00.085572Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:5 removed:0 size:4.6kB cached:0/4 2026-09-09T21:04:00.085596Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:8 removed:0 size:5.2kB cached:0/4 2026-09-09T21:04:00.085695Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:4 removed:0 size:282B empty:4 cached:0/4 2026-09-09T21:04:00.085872Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:4 removed:0 size:282B empty:1 cached:3/4 2026-09-09T21:04:00.086074Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:04:00.086124Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:00.086297Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:00.086437Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T21:04:04.322187Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local": {}, "outbound|9004||payload-pre-processing.openshift-ingress.svc.cluster.local": {}, "outbound|9004||payload-processing.openshift-ingress.svc.cluster.local": {}, "outbound|9090||maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local": {} } } 2026-09-09T21:04:05.452377Z info delta ADS: "10.133.0.24:58380" maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress-2 terminated 2026-09-09T21:04:06.021987Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:04:06.022015Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:04:06.069538Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:04:06.109541Z info ads Push debounce stable[90] 3 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 2 more configs: 100.84251ms since last change, 122.182525ms since last push, full=false 2026-09-09T21:04:06.109585Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-09-09T21:04:00Z/50 2026-09-09T21:04:06.142750Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress-3 2026-09-09T21:04:06.143510Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-09T21:04:06.214458Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 filtered:0 2026-09-09T21:04:06.407401Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:04:06.414506Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-09T21:04:06.414568Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-09T21:04:07.011258Z info ads Push debounce stable[91] 8 for config Secret/llm/deployer-dockercfg-tpwhp and 4 more configs: 100.391654ms since last change, 159.384649ms since last push, full=true 2026-09-09T21:04:07.011390Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T21:04:07Z/51 2026-09-09T21:04:07.012390Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:129 removed:0 size:149.2kB cached:124/128 2026-09-09T21:04:07.012498Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-09T21:04:07.013082Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 2026-09-09T21:04:07.013258Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 2026-09-09T21:04:07.013357Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:04:07.013566Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:07.013658Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T21:04:07.013671Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:07.013715Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:04:07.013729Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:04:11.024772Z info ads Push debounce stable[92] 2 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.398745ms since last change, 122.467999ms since last push, full=false 2026-09-09T21:04:11.024847Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:04:07Z/51 2026-09-09T21:04:12.096000Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-09T21:04:12.096494Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:128 removed:0 size:30.1kB empty:0 cached:128/128 2026-09-09T21:04:12.096735Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:04:12.096970Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T21:04:12.097014Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:04:12.136015Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:04:12.136041Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:04:12.207690Z info ads Push debounce stable[93] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.642535ms since last change, 100.642479ms since last push, full=false 2026-09-09T21:04:12.207733Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:04:07Z/51 2026-09-09T21:04:12.230346Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:04:14.322196Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T21:04:19.125702Z info ads Push debounce stable[94] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.225267ms since last change, 100.225215ms since last push, full=false 2026-09-09T21:04:19.125758Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:04:07Z/51 2026-09-09T21:04:19.267614Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:04:19.440685Z info ads Push debounce stable[95] 3 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.447742ms since last change, 180.870417ms since last push, full=true 2026-09-09T21:04:19.441208Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T21:04:19Z/52 2026-09-09T21:04:19.441789Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T21:04:19.441857Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T21:04:19.442074Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:19.442147Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:04:19.442161Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:19.442686Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T21:04:19.447641Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-09T21:04:19.448316Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-09T21:04:20.018853Z info ads Push debounce stable[96] 2 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway and 1 more configs: 100.971953ms since last change, 108.137773ms since last push, full=true 2026-09-09T21:04:20.022152Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T21:04:20Z/53 2026-09-09T21:04:20.023153Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:130 removed:0 size:150.4kB cached:124/129 2026-09-09T21:04:20.023653Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:129 removed:0 size:30.6kB empty:1 cached:128/129 2026-09-09T21:04:20.023908Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:20.024000Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:20.027880Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:133 removed:0 size:151.0kB cached:0/129 2026-09-09T21:04:20.028842Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-09T21:04:20.029386Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T21:04:20.029989Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T21:04:20.145998Z info ads Push debounce stable[97] 2 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-dq9bm: 100.209623ms since last change, 112.365116ms since last push, full=false 2026-09-09T21:04:20.146048Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:04:20Z/53 2026-09-09T21:04:21.079467Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:04:21.180356Z info ads Push debounce stable[98] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.786734ms since last change, 100.786679ms since last push, full=true 2026-09-09T21:04:21.180896Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T21:04:21Z/54 2026-09-09T21:04:21.181474Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:04:21.181551Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-09-09T21:04:21.181475Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:04:21.181675Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-09-09T21:04:21.181805Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:21.181899Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:21.182084Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T21:04:21.182435Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T21:04:22.977625Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:04:23.139428Z info ads Push debounce stable[99] 5 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs and 3 more configs: 100.546345ms since last change, 204.626227ms since last push, full=true 2026-09-09T21:04:23.140032Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T21:04:23Z/55 2026-09-09T21:04:23.140619Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:04:23.140664Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:04:23.141314Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-09T21:04:23.141404Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-09T21:04:23.141592Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:23.141760Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T21:04:23.141811Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:23.141852Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:04:23.142361Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T21:04:23.142401Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:04:23.145373Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-09T21:04:23.145524Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-09T21:04:23.925645Z info ads Push debounce stable[100] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.224276ms since last change, 100.224188ms since last push, full=true 2026-09-09T21:04:23.931746Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T21:04:23Z/56 2026-09-09T21:04:23.932792Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:131 removed:0 size:151.5kB cached:130/130 2026-09-09T21:04:23.933362Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T21:04:23.933703Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:23.933887Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:23.937523Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-09T21:04:23.938164Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T21:04:23.938533Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T21:04:23.939261Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T21:04:24.321744Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T21:04:25.021450Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:04:25.122092Z info ads Push debounce stable[101] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.59902ms since last change, 100.59895ms since last push, full=true 2026-09-09T21:04:25.122649Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T21:04:25Z/57 2026-09-09T21:04:25.123232Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:04:25.123327Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-09T21:04:25.123346Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:04:25.123410Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-09T21:04:25.123565Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:25.123650Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:25.123833Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T21:04:25.124718Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T21:04:31.729038Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:04:31.853996Z info ads Push debounce stable[102] 5 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs and 3 more configs: 100.372066ms since last change, 224.504153ms since last push, full=true 2026-09-09T21:04:31.854688Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T21:04:31Z/58 2026-09-09T21:04:31.855271Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:04:31.855645Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:04:31.855831Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T21:04:31.856216Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T21:04:31.856225Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T21:04:31.856500Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:31.856592Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:31.856692Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:04:31.856987Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T21:04:31.857061Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:04:31.859355Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-09T21:04:31.860378Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-09T21:04:33.040886Z info ads Push debounce stable[103] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.211511ms since last change, 100.211459ms since last push, full=true 2026-09-09T21:04:33.051611Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T21:04:33Z/59 2026-09-09T21:04:33.052428Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:132 removed:0 size:152.7kB cached:131/131 2026-09-09T21:04:33.053013Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T21:04:33.053332Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:33.053440Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:33.055873Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-09T21:04:33.056296Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T21:04:33.056593Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T21:04:33.057127Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T21:04:33.156614Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:04:33.257460Z info ads Push debounce stable[104] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.802395ms since last change, 100.802341ms since last push, full=true 2026-09-09T21:04:33.257998Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T21:04:33Z/60 2026-09-09T21:04:33.258639Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:04:33.258651Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:04:33.258730Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T21:04:33.258862Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T21:04:33.258993Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:33.259091Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:33.259338Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T21:04:33.259895Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T21:04:34.321789Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T21:04:42.285532Z info ads Push debounce stable[105] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.393671ms since last change, 100.39361ms since last push, full=false 2026-09-09T21:04:42.285612Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:04:33Z/60 2026-09-09T21:04:42.359964Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:04:42.544482Z info ads Push debounce stable[106] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.582114ms since last change, 216.811046ms since last push, full=true 2026-09-09T21:04:42.545118Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T21:04:42Z/61 2026-09-09T21:04:42.545767Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:04:42.545776Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:04:42.546460Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:131 removed:0 size:31.0kB empty:0 cached:131/131 2026-09-09T21:04:42.546489Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:131 removed:0 size:31.0kB empty:0 cached:131/131 2026-09-09T21:04:42.546789Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:42.546866Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T21:04:42.546924Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:42.547029Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:04:42.548018Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T21:04:42.548066Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:04:42.550276Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-09T21:04:42.550609Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-09T21:04:44.034781Z info ads Push debounce stable[107] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 101.058885ms since last change, 101.058804ms since last push, full=true 2026-09-09T21:04:44.042964Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T21:04:44Z/62 2026-09-09T21:04:44.043816Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:133 removed:0 size:153.9kB cached:131/132 2026-09-09T21:04:44.044698Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:132 removed:0 size:31.0kB empty:0 cached:132/132 2026-09-09T21:04:44.045000Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:44.045142Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:44.046872Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-09T21:04:44.047483Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:132 removed:0 size:31.0kB empty:0 cached:132/132 2026-09-09T21:04:44.047861Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T21:04:44.048597Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T21:04:44.126250Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:04:44.226505Z info ads Push debounce stable[108] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.214159ms since last change, 100.214092ms since last push, full=true 2026-09-09T21:04:44.227052Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T21:04:44Z/63 2026-09-09T21:04:44.227652Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:04:44.227725Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T21:04:44.227656Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:04:44.227794Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-09T21:04:44.227998Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:44.228074Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:44.228205Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T21:04:44.228996Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T21:04:44.321803Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T21:04:46.967427Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:04:47.091215Z info ads Push debounce stable[109] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.356642ms since last change, 162.925368ms since last push, full=true 2026-09-09T21:04:47.091817Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T21:04:47Z/64 2026-09-09T21:04:47.092351Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T21:04:47.092479Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T21:04:47.092953Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:132 removed:0 size:31.0kB empty:0 cached:132/132 2026-09-09T21:04:47.093215Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:132 removed:0 size:31.0kB empty:0 cached:132/132 2026-09-09T21:04:47.093289Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T21:04:47.093474Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:47.093580Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:47.093677Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:04:47.094465Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T21:04:47.094499Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:04:47.096365Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-09T21:04:47.097129Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-09T21:04:48.862123Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:04:48.962407Z info ads Push debounce stable[110] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.221095ms since last change, 100.220992ms since last push, full=true 2026-09-09T21:04:48.962923Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T21:04:48Z/65 2026-09-09T21:04:48.963542Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T21:04:48.963617Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T21:04:48.963688Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 2026-09-09T21:04:48.963622Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-09-09T21:04:48.963964Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:48.964062Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:48.964415Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T21:04:48.965507Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T21:04:49.334407Z info ads Push debounce stable[111] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.280687ms since last change, 100.280635ms since last push, full=true 2026-09-09T21:04:49.344062Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T21:04:49Z/66 2026-09-09T21:04:49.344848Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:134 removed:0 size:155.2kB cached:133/133 2026-09-09T21:04:49.345299Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:133 removed:0 size:31.1kB empty:0 cached:133/133 2026-09-09T21:04:49.345513Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:49.345611Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:49.348032Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-09T21:04:49.348753Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:133 removed:0 size:31.1kB empty:0 cached:133/133 2026-09-09T21:04:49.349226Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T21:04:49.350250Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T21:04:53.277702Z info ads Push debounce stable[112] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.020078ms since last change, 100.020016ms since last push, full=false 2026-09-09T21:04:53.277762Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:04:49Z/66 2026-09-09T21:04:54.321656Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T21:04:58.000806Z info ads Push debounce stable[113] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.066417ms since last change, 100.066353ms since last push, full=false 2026-09-09T21:04:58.000869Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:04:49Z/66 2026-09-09T21:04:58.588051Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:04:58.758194Z info ads Push debounce stable[114] 5 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs and 3 more configs: 100.878478ms since last change, 219.008683ms since last push, full=true 2026-09-09T21:04:58.759090Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T21:04:58Z/67 2026-09-09T21:04:58.759782Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:04:58.759783Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:04:58.760480Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-09T21:04:58.760578Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-09T21:04:58.760779Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:04:58.760892Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:04:58.760941Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:04:58.761078Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T21:04:58.762284Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T21:04:58.762332Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:04:58.764419Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-09T21:04:58.764896Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-09T21:05:00.197633Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:05:00.297981Z info ads Push debounce stable[115] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.215455ms since last change, 100.215365ms since last push, full=true 2026-09-09T21:05:00.298575Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T21:05:00Z/68 2026-09-09T21:05:00.299119Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:05:00.299200Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-09T21:05:00.299123Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:05:00.299308Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 2026-09-09T21:05:00.299536Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:05:00.299636Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:05:00.300076Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T21:05:00.301167Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T21:05:01.045852Z info ads Push debounce stable[116] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.217172ms since last change, 100.217111ms since last push, full=true 2026-09-09T21:05:01.057365Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T21:05:01Z/69 2026-09-09T21:05:01.058274Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:135 removed:0 size:156.3kB cached:132/134 2026-09-09T21:05:01.058930Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T21:05:01.059268Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:05:01.059390Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:05:01.061479Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-09T21:05:01.062123Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T21:05:01.062529Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T21:05:01.063462Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T21:05:04.321438Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T21:05:05.154306Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:05:05.323359Z info ads Push debounce stable[117] 5 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local and 3 more configs: 100.965344ms since last change, 197.354593ms since last push, full=true 2026-09-09T21:05:05.324001Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T21:05:05Z/70 2026-09-09T21:05:05.324609Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T21:05:05.324609Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T21:05:05.325290Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T21:05:05.325357Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T21:05:05.325578Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:05:05.325740Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:05:05.325785Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:05:05.325907Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T21:05:05.327130Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T21:05:05.327164Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:05:05.328826Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-09T21:05:05.328985Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 filtered:134 2026-09-09T21:05:06.284301Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:05:06.384914Z info ads Push debounce stable[118] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.564529ms since last change, 100.564475ms since last push, full=true 2026-09-09T21:05:06.385491Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T21:05:06Z/71 2026-09-09T21:05:06.386052Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T21:05:06.386119Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T21:05:06.386147Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-09T21:05:06.386191Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-09-09T21:05:06.386478Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:05:06.386572Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:05:06.386873Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T21:05:06.389270Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T21:05:08.273900Z info ads Push debounce stable[119] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.216474ms since last change, 100.216422ms since last push, full=true 2026-09-09T21:05:08.287048Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T21:05:08Z/72 2026-09-09T21:05:08.287855Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:136 removed:0 size:157.6kB cached:135/135 2026-09-09T21:05:08.288345Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T21:05:08.288661Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:05:08.288781Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-z7ck4.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:05:08.292864Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-09T21:05:08.293592Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T21:05:08.294479Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-09T21:05:08.296169Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T21:05:14.321653Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmpg9.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T21:05:14.489929Z info model Incremental push, service kserve-controller-manager-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:05:14.492932Z info model Incremental push, service kserve-controller-manager-metrics-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:05:14.593329Z info ads Push debounce stable[120] 2 for config ServiceEntry/opendatahub/kserve-controller-manager-service.opendatahub.svc.cluster.local and 1 more configs: 100.353793ms since last change, 103.352805ms since last push, full=false 2026-09-09T21:05:14.593385Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:05:08Z/72 2026-09-09T21:05:25.537225Z info ads Push debounce stable[121] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.218049ms since last change, 100.217924ms since last push, full=false 2026-09-09T21:05:25.537295Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:05:08Z/72 2026-09-09T21:05:28.229539Z info ads Push debounce stable[122] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.216379ms since last change, 100.216295ms since last push, full=false 2026-09-09T21:05:28.229590Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:05:08Z/72 2026-09-09T21:05:59.925188Z info ads Push debounce stable[123] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.211348ms since last change, 100.211288ms since last push, full=false 2026-09-09T21:05:59.925257Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:05:08Z/72 2026-09-09T21:06:16.528025Z info ads Push debounce stable[124] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.1647ms since last change, 100.164583ms since last push, full=false 2026-09-09T21:06:16.528070Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:05:08Z/72 2026-09-09T21:06:18.129973Z info ads Push debounce stable[125] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.211058ms since last change, 100.210987ms since last push, full=false 2026-09-09T21:06:18.130035Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:05:08Z/72 2026-09-09T21:06:25.720943Z info ads Push debounce stable[126] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.224848ms since last change, 100.224795ms since last push, full=false 2026-09-09T21:06:25.720996Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:05:08Z/72 2026-09-09T21:06:37.328893Z info ads Push debounce stable[127] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.225024ms since last change, 100.224954ms since last push, full=false 2026-09-09T21:06:37.328944Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:05:08Z/72