2026-09-09T02:19:53.668522Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:126 removed:0 size:29.9kB empty:0 cached:126/126 2026-09-09T02:19:53.668797Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T02:19:53.669104Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T02:19:53.669145Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T02:19:53.678661Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:126 2026-09-09T02:19:53.693826Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:126 2026-09-09T02:19:54.515058Z info ads Push debounce stable[84] 1 for config EnvoyFilter/openshift-ingress/payload-processing: 100.256324ms since last change, 100.256272ms since last push, full=true 2026-09-09T02:19:54.516074Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T02:19:54Z/47 2026-09-09T02:19:54.517190Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T02:19:54.517197Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:132 removed:0 size:149.7kB cached:128/128 2026-09-09T02:19:54.517866Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T02:19:54.518175Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:19:54.518279Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:19:54.518452Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T02:19:54.518837Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T02:19:54.519137Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T02:19:56.749726Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-09T02:19:56.850182Z info ads Push debounce stable[85] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.234884ms since last change, 100.23481ms since last push, full=true 2026-09-09T02:19:56.850733Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T02:19:56Z/48 2026-09-09T02:19:56.851307Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-09-09T02:19:56.851377Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:71B empty:1 cached:0/1 2026-09-09T02:19:56.851378Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.7kB cached:0/1 2026-09-09T02:19:56.851441Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:71B empty:0 cached:1/1 2026-09-09T02:19:56.851573Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:19:56.851658Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:19:56.851755Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T02:19:56.852001Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T02:19:57.599503Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-09T02:19:57.618133Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T02:19:57.619089Z info model Full push, new service odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T02:19:57.719162Z info ads Push debounce stable[86] 3 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local and 2 more configs: 100.025967ms since last change, 119.589408ms since last push, full=true 2026-09-09T02:19:57.719715Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T02:19:57Z/49 2026-09-09T02:19:57.720399Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:7 removed:0 size:4.1kB cached:0/3 2026-09-09T02:19:57.720483Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:3 removed:0 size:211B empty:3 cached:0/3 2026-09-09T02:19:57.720402Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:4 removed:0 size:3.5kB cached:0/3 2026-09-09T02:19:57.720646Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:3 removed:0 size:211B empty:0 cached:3/3 2026-09-09T02:19:57.720779Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T02:19:57.720838Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:19:57.720966Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:19:57.721115Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T02:19:58.594067Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local": {}, "outbound|9004||payload-pre-processing.openshift-ingress.svc.cluster.local": {}, "outbound|9090||maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local": {} } } 2026-09-09T02:20:02.597458Z info delta ADS: "10.134.0.29:45380" maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress-2 terminated 2026-09-09T02:20:03.652179Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T02:20:03.652212Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T02:20:03.690102Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T02:20:03.739117Z info ads Push debounce stable[87] 3 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 2 more configs: 100.384853ms since last change, 121.232532ms since last push, full=false 2026-09-09T02:20:03.739166Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-09-09T02:19:57Z/49 2026-09-09T02:20:03.780483Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress-3 2026-09-09T02:20:03.781292Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-09T02:20:03.855955Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 filtered:0 2026-09-09T02:20:03.940489Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T02:20:03.948787Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-09T02:20:03.948835Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-09T02:20:04.772062Z info ads Push debounce stable[88] 8 for config Secret/llm/builder-dockercfg-bjf77 and 4 more configs: 100.303765ms since last change, 168.643679ms since last push, full=true 2026-09-09T02:20:04.772200Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T02:20:04Z/50 2026-09-09T02:20:04.773255Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:129 removed:0 size:149.2kB cached:124/128 2026-09-09T02:20:04.773532Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-09T02:20:04.773886Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 2026-09-09T02:20:04.774147Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 2026-09-09T02:20:04.774225Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:04.774350Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:04.774397Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T02:20:04.774415Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T02:20:04.774687Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T02:20:04.774734Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T02:20:07.862770Z info ads Push debounce stable[89] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.356733ms since last change, 100.356663ms since last push, full=false 2026-09-09T02:20:07.862847Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:20:04Z/50 2026-09-09T02:20:08.594880Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T02:20:09.714769Z info ads Push debounce stable[90] 1 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local: 100.870034ms since last change, 100.869973ms since last push, full=false 2026-09-09T02:20:09.714847Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:20:04Z/50 2026-09-09T02:20:09.840917Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-09T02:20:09.841637Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:128 removed:0 size:30.2kB empty:0 cached:128/128 2026-09-09T02:20:09.841999Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T02:20:09.842330Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T02:20:09.842371Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T02:20:09.859608Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T02:20:09.859646Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T02:20:09.934640Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T02:20:09.947625Z info ads Push debounce stable[91] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 101.015761ms since last change, 101.01571ms since last push, full=false 2026-09-09T02:20:09.947692Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:20:04Z/50 2026-09-09T02:20:10.767768Z info ads Push debounce stable[92] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.227101ms since last change, 100.227033ms since last push, full=false 2026-09-09T02:20:10.767853Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:20:04Z/50 2026-09-09T02:20:10.910155Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T02:20:11.011207Z info ads Push debounce stable[93] 2 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.995153ms since last change, 107.392665ms since last push, full=true 2026-09-09T02:20:11.011803Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T02:20:11Z/51 2026-09-09T02:20:11.012398Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T02:20:11.012401Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T02:20:11.012676Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:11.012769Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:11.012872Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T02:20:11.013158Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T02:20:11.017554Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-09T02:20:11.017702Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-09T02:20:11.162092Z info ads Push debounce stable[94] 1 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~*: 100.341838ms since last change, 100.341775ms since last push, full=true 2026-09-09T02:20:11.162228Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T02:20:11Z/52 2026-09-09T02:20:11.162766Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T02:20:11.162766Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:11.163056Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:11.163412Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T02:20:11.351862Z info ads Push debounce stable[95] 1 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc: 100.222895ms since last change, 100.222796ms since last push, full=true 2026-09-09T02:20:11.352008Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T02:20:11Z/53 2026-09-09T02:20:11.352492Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T02:20:11.352671Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T02:20:11.353074Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:129 removed:0 size:30.7kB empty:1 cached:128/129 2026-09-09T02:20:11.353322Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:11.353412Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:11.353410Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T02:20:11.353693Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T02:20:11.354128Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T02:20:11.665781Z info ads Push debounce stable[96] 3 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-qnhcf and 1 more configs: 100.235094ms since last change, 203.831178ms since last push, full=true 2026-09-09T02:20:11.669037Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T02:20:11Z/54 2026-09-09T02:20:11.670310Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:130 removed:0 size:150.4kB cached:125/129 2026-09-09T02:20:11.670927Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T02:20:11.671232Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:11.671334Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:11.671382Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T02:20:11.673598Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:133 removed:0 size:151.0kB cached:0/129 2026-09-09T02:20:11.674098Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T02:20:11.674368Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T02:20:11.674685Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T02:20:11.674713Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T02:20:12.853125Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T02:20:12.953436Z info ads Push debounce stable[97] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.254404ms since last change, 100.254353ms since last push, full=true 2026-09-09T02:20:12.954062Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T02:20:12Z/55 2026-09-09T02:20:12.954666Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T02:20:12.954722Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T02:20:12.954761Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-09-09T02:20:12.954777Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-09-09T02:20:12.955167Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:12.955231Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T02:20:12.955271Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:12.955633Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T02:20:18.594862Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T02:20:20.290531Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T02:20:20.457859Z info ads Push debounce stable[98] 5 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs and 3 more configs: 100.061617ms since last change, 199.161481ms since last push, full=true 2026-09-09T02:20:20.458473Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T02:20:20Z/56 2026-09-09T02:20:20.458940Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T02:20:20.459110Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T02:20:20.459667Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T02:20:20.459704Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T02:20:20.459959Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:20.460089Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:20.460135Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T02:20:20.460283Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T02:20:20.460785Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T02:20:20.460831Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T02:20:20.463426Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-09T02:20:20.463467Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-09T02:20:21.473434Z info ads Push debounce stable[99] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.216124ms since last change, 100.216062ms since last push, full=true 2026-09-09T02:20:21.478283Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T02:20:21Z/57 2026-09-09T02:20:21.479098Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:131 removed:0 size:151.5kB cached:130/130 2026-09-09T02:20:21.479688Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T02:20:21.479958Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:21.480068Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:21.482433Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-09T02:20:21.482977Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T02:20:21.483466Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T02:20:21.484220Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T02:20:22.013143Z info ads Push debounce stable[100] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.91357ms since last change, 100.913504ms since last push, full=false 2026-09-09T02:20:22.013214Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:20:21Z/57 2026-09-09T02:20:22.199554Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T02:20:22.299922Z info ads Push debounce stable[101] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.224602ms since last change, 100.224533ms since last push, full=true 2026-09-09T02:20:22.300490Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T02:20:22Z/58 2026-09-09T02:20:22.301141Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T02:20:22.301162Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T02:20:22.301216Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-09T02:20:22.301234Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-09T02:20:22.301477Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:22.301585Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:22.301781Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T02:20:22.302359Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T02:20:27.061973Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T02:20:27.202793Z info ads Push debounce stable[102] 4 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 2 more configs: 100.38881ms since last change, 241.164281ms since last push, full=true 2026-09-09T02:20:27.203380Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T02:20:27Z/59 2026-09-09T02:20:27.203870Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T02:20:27.203872Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T02:20:27.204194Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:27.204284Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:27.204315Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T02:20:27.204513Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T02:20:27.205108Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T02:20:27.205148Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T02:20:27.209436Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-09T02:20:27.209950Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-09T02:20:27.352288Z info ads Push debounce stable[103] 1 for config DestinationRule/llm/e2e-embedding-simulated-kserve-workload-svc: 100.211882ms since last change, 100.211823ms since last push, full=true 2026-09-09T02:20:27.352453Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T02:20:27Z/60 2026-09-09T02:20:27.352947Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T02:20:27.352989Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T02:20:27.353602Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:131 removed:0 size:31.0kB empty:0 cached:131/131 2026-09-09T02:20:27.353668Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:131 removed:0 size:31.0kB empty:1 cached:130/131 2026-09-09T02:20:27.353963Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:27.354140Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T02:20:27.354150Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:27.354824Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T02:20:28.594091Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T02:20:28.686192Z info ads Push debounce stable[104] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.603467ms since last change, 100.603399ms since last push, full=true 2026-09-09T02:20:28.693427Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T02:20:28Z/61 2026-09-09T02:20:28.694315Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:132 removed:0 size:152.7kB cached:130/131 2026-09-09T02:20:28.694898Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:131 removed:0 size:31.0kB empty:0 cached:131/131 2026-09-09T02:20:28.695188Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:28.695368Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:28.697375Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-09T02:20:28.697828Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:131 removed:0 size:31.0kB empty:0 cached:131/131 2026-09-09T02:20:28.698461Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T02:20:28.699691Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T02:20:28.760391Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T02:20:28.860696Z info ads Push debounce stable[105] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.229834ms since last change, 100.229787ms since last push, full=true 2026-09-09T02:20:28.861290Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T02:20:28Z/62 2026-09-09T02:20:28.861787Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T02:20:28.861861Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T02:20:28.861867Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T02:20:28.861931Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-09T02:20:28.862175Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:28.862277Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:28.862375Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T02:20:28.862944Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T02:20:31.357854Z info ads Push debounce stable[106] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.476923ms since last change, 100.476871ms since last push, full=false 2026-09-09T02:20:31.357936Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:20:28Z/62 2026-09-09T02:20:37.296390Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T02:20:37.469810Z info ads Push debounce stable[107] 5 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local and 3 more configs: 100.051705ms since last change, 203.35678ms since last push, full=true 2026-09-09T02:20:37.470475Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T02:20:37Z/63 2026-09-09T02:20:37.471082Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T02:20:37.471092Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T02:20:37.471754Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:131 removed:0 size:31.1kB empty:0 cached:131/131 2026-09-09T02:20:37.471805Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:131 removed:0 size:31.1kB empty:0 cached:131/131 2026-09-09T02:20:37.472010Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:37.472144Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:37.472234Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T02:20:37.472247Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T02:20:37.472991Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T02:20:37.473040Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T02:20:37.475360Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-09T02:20:37.475420Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-09T02:20:37.915144Z info ads Push debounce stable[108] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.694157ms since last change, 100.69408ms since last push, full=false 2026-09-09T02:20:37.915215Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:20:37Z/63 2026-09-09T02:20:38.593879Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T02:20:38.901138Z info ads Push debounce stable[109] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.244021ms since last change, 100.243967ms since last push, full=true 2026-09-09T02:20:38.909249Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T02:20:38Z/64 2026-09-09T02:20:38.910410Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:133 removed:0 size:153.9kB cached:130/132 2026-09-09T02:20:38.911070Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:132 removed:0 size:31.4kB empty:0 cached:132/132 2026-09-09T02:20:38.911365Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:38.911467Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:38.913893Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-09T02:20:38.914355Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:132 removed:0 size:31.4kB empty:0 cached:132/132 2026-09-09T02:20:38.914679Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T02:20:38.915437Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T02:20:39.006040Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T02:20:39.106311Z info ads Push debounce stable[110] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.214608ms since last change, 100.214558ms since last push, full=true 2026-09-09T02:20:39.106873Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T02:20:39Z/65 2026-09-09T02:20:39.107461Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T02:20:39.107553Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T02:20:39.107462Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T02:20:39.107668Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-09T02:20:39.107897Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:39.108004Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:39.108062Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T02:20:39.109263Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T02:20:48.155644Z info ads Push debounce stable[111] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.227408ms since last change, 100.227344ms since last push, full=false 2026-09-09T02:20:48.155695Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:20:39Z/65 2026-09-09T02:20:48.594558Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T02:20:49.663624Z info ads Push debounce stable[112] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.952743ms since last change, 100.95269ms since last push, full=false 2026-09-09T02:20:49.663702Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:20:39Z/65 2026-09-09T02:20:49.675674Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T02:20:49.813110Z info ads Push debounce stable[113] 4 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local and 2 more configs: 100.628701ms since last change, 145.012721ms since last push, full=true 2026-09-09T02:20:49.813718Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T02:20:49Z/66 2026-09-09T02:20:49.814295Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T02:20:49.814295Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T02:20:49.814899Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:132 removed:0 size:31.6kB empty:0 cached:132/132 2026-09-09T02:20:49.815076Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:132 removed:0 size:31.6kB empty:0 cached:132/132 2026-09-09T02:20:49.815272Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T02:20:49.815277Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:49.815570Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:49.816303Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T02:20:49.818823Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-09T02:20:49.819067Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-09T02:20:50.867423Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T02:20:50.967808Z info ads Push debounce stable[114] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.251872ms since last change, 100.25182ms since last push, full=true 2026-09-09T02:20:50.968456Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T02:20:50Z/67 2026-09-09T02:20:50.969073Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T02:20:50.969112Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T02:20:50.969147Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-09-09T02:20:50.969171Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 2026-09-09T02:20:50.969406Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:50.969492Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:50.969629Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T02:20:50.970998Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T02:20:51.194142Z info ads Push debounce stable[115] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.220094ms since last change, 100.220042ms since last push, full=true 2026-09-09T02:20:51.203968Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T02:20:51Z/68 2026-09-09T02:20:51.204841Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:134 removed:0 size:155.2kB cached:132/133 2026-09-09T02:20:51.205559Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:133 removed:0 size:31.7kB empty:0 cached:133/133 2026-09-09T02:20:51.205836Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:20:51.205930Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:20:51.208220Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-09T02:20:51.208858Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:133 removed:0 size:31.7kB empty:0 cached:133/133 2026-09-09T02:20:51.209344Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T02:20:51.210309Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T02:20:58.594370Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T02:21:01.027417Z info ads Push debounce stable[116] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.902818ms since last change, 100.902718ms since last push, full=false 2026-09-09T02:21:01.027486Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:20:51Z/68 2026-09-09T02:21:01.985872Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T02:21:02.152764Z info ads Push debounce stable[117] 5 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs and 3 more configs: 101.06735ms since last change, 197.535464ms since last push, full=true 2026-09-09T02:21:02.153428Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T02:21:02Z/69 2026-09-09T02:21:02.153974Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T02:21:02.153975Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T02:21:02.154655Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:133 removed:0 size:31.9kB empty:0 cached:133/133 2026-09-09T02:21:02.154749Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:133 removed:0 size:31.9kB empty:0 cached:133/133 2026-09-09T02:21:02.154929Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:21:02.155048Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:21:02.155095Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T02:21:02.155225Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T02:21:02.156186Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T02:21:02.156221Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T02:21:02.158453Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-09T02:21:02.158645Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-09T02:21:02.928507Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T02:21:03.028909Z info ads Push debounce stable[118] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.333337ms since last change, 100.333269ms since last push, full=true 2026-09-09T02:21:03.029487Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T02:21:03Z/70 2026-09-09T02:21:03.030123Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T02:21:03.030132Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T02:21:03.030205Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-09T02:21:03.030214Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-09T02:21:03.030459Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:21:03.030611Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:21:03.031217Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T02:21:03.032406Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T02:21:04.701383Z info ads Push debounce stable[119] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.214478ms since last change, 100.214417ms since last push, full=true 2026-09-09T02:21:04.717657Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T02:21:04Z/71 2026-09-09T02:21:04.718565Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:135 removed:0 size:156.3kB cached:133/134 2026-09-09T02:21:04.719272Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:134 removed:0 size:31.9kB empty:0 cached:134/134 2026-09-09T02:21:04.719529Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:21:04.719609Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:21:04.722078Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-09T02:21:04.722653Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:134 removed:0 size:31.9kB empty:0 cached:134/134 2026-09-09T02:21:04.722972Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T02:21:04.723884Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T02:21:08.594404Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T02:21:13.088889Z info ads Push debounce stable[120] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.090615ms since last change, 100.090563ms since last push, full=false 2026-09-09T02:21:13.088977Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:04Z/71 2026-09-09T02:21:15.859569Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T02:21:15.984793Z info ads Push debounce stable[121] 5 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs and 3 more configs: 100.02762ms since last change, 216.263111ms since last push, full=true 2026-09-09T02:21:15.985522Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T02:21:15Z/72 2026-09-09T02:21:15.986097Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T02:21:15.986097Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T02:21:15.986827Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:134 removed:0 size:32.1kB empty:0 cached:134/134 2026-09-09T02:21:15.986839Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:134 removed:0 size:32.1kB empty:0 cached:134/134 2026-09-09T02:21:15.987144Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:21:15.987248Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:21:15.987299Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T02:21:15.987653Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T02:21:15.988806Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T02:21:15.988841Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T02:21:15.991104Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-09T02:21:15.991217Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 filtered:134 2026-09-09T02:21:17.461917Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T02:21:17.562189Z info ads Push debounce stable[122] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.217614ms since last change, 100.217555ms since last push, full=true 2026-09-09T02:21:17.562807Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T02:21:17Z/73 2026-09-09T02:21:17.563486Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T02:21:17.563551Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T02:21:17.563584Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-09T02:21:17.563607Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-09-09T02:21:17.563953Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:21:17.564092Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:21:17.564131Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T02:21:17.565213Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T02:21:18.594204Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T02:21:19.012782Z info ads Push debounce stable[123] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.226145ms since last change, 100.226086ms since last push, full=true 2026-09-09T02:21:19.025914Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:21:19.027129Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:136 removed:0 size:157.6kB cached:134/135 2026-09-09T02:21:19.027731Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:135 removed:0 size:32.2kB empty:0 cached:135/135 2026-09-09T02:21:19.027959Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T02:21:19.028071Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-bc7zt.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T02:21:19.030103Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-09T02:21:19.030886Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:135 removed:0 size:32.2kB empty:0 cached:135/135 2026-09-09T02:21:19.031453Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-09T02:21:19.032674Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T02:21:26.062711Z info ads Push debounce stable[124] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.211815ms since last change, 100.21176ms since last push, full=false 2026-09-09T02:21:26.062772Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:21:26.617289Z info ads Push debounce stable[125] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.975559ms since last change, 100.975485ms since last push, full=false 2026-09-09T02:21:26.617365Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:21:28.594711Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-n2frh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T02:21:31.161210Z info ads Push debounce stable[126] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.211905ms since last change, 100.211845ms since last push, full=false 2026-09-09T02:21:31.161270Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:21:32.968508Z info ads Push debounce stable[127] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.427025ms since last change, 100.42696ms since last push, full=false 2026-09-09T02:21:32.968575Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:21:35.416088Z info model Incremental push, service kserve-controller-manager-metrics-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T02:21:35.418524Z info model Incremental push, service kserve-controller-manager-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T02:21:35.518693Z info ads Push debounce stable[128] 2 for config ServiceEntry/opendatahub/kserve-controller-manager-service.opendatahub.svc.cluster.local and 1 more configs: 100.069054ms since last change, 102.552842ms since last push, full=false 2026-09-09T02:21:35.518760Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:21:42.862052Z info ads Push debounce stable[129] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.223843ms since last change, 100.223784ms since last push, full=false 2026-09-09T02:21:42.862106Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:21:51.754642Z info ads Push debounce stable[130] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.242494ms since last change, 100.242439ms since last push, full=false 2026-09-09T02:21:51.754712Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:22:16.468744Z info ads Push debounce stable[131] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.232442ms since last change, 100.232377ms since last push, full=false 2026-09-09T02:22:16.468804Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:22:42.061621Z info ads Push debounce stable[132] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.228028ms since last change, 100.227963ms since last push, full=false 2026-09-09T02:22:42.061682Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:22:45.006367Z info ads Push debounce stable[133] 6 for config ServiceEntry/kuadrant-system/authorino-authorino-authorization.kuadrant-system.svc.cluster.local and 2 more configs: 101.066368ms since last change, 129.538305ms since last push, full=false 2026-09-09T02:22:45.006421Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:22:45.285422Z info ads Push debounce stable[134] 3 for config ServiceEntry/kuadrant-system/authorino-controller-metrics.kuadrant-system.svc.cluster.local and 2 more configs: 100.108771ms since last change, 100.247793ms since last push, full=false 2026-09-09T02:22:45.285499Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:22:45.516767Z info ads Push debounce stable[135] 7 for config Secret/premium-users-namespace/default-dockercfg-jv2v4 and 3 more configs: 100.423795ms since last change, 142.880976ms since last push, full=false 2026-09-09T02:22:45.516836Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:22:45.703701Z info ads Push debounce stable[136] 2 for config Secret/premium-users-namespace/premium-service-account-dockercfg-bh4z8: 100.15674ms since last change, 114.180945ms since last push, full=false 2026-09-09T02:22:45.703751Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:22:46.646341Z info ads Push debounce stable[137] 7 for config ConfigMap/maas-admin/kube-root-ca.crt and 3 more configs: 100.214324ms since last change, 140.290188ms since last push, full=false 2026-09-09T02:22:46.646401Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:22:46.828685Z info ads Push debounce stable[138] 2 for config Secret/maas-admin/tester-admin-user-dockercfg-tqndb: 100.950857ms since last change, 113.861619ms since last push, full=false 2026-09-09T02:22:46.828757Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74 2026-09-09T02:22:48.352381Z info ads Push debounce stable[139] 2 for config Secret/default/tester-regular-user-dockercfg-ft9wz: 100.027723ms since last change, 113.875042ms since last push, full=false 2026-09-09T02:22:48.352448Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T02:21:19Z/74