2026-09-10T02:57:25.369814Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:4 removed:0 size:2.5kB cached:0/2 2026-09-10T02:57:25.370059Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-10T02:57:25.370089Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-10T02:57:25.370114Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-10T02:57:25.370189Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:57:25.370279Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:57:25.374049Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 filtered:122 2026-09-10T02:57:25.374608Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:2 removed:0 size:147B empty:0 cached:2/2 filtered:122 2026-09-10T02:57:25.559151Z info ads Push debounce stable[81] 1 for config Secret/opendatahub/maas-controller-webhook-cert: 101.077043ms since last change, 101.076982ms since last push, full=false 2026-09-10T02:57:25.559222Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:57:25Z/49 2026-09-10T02:57:25.763009Z info ads Push debounce stable[82] 1 for config Secret/opendatahub/maas-controller-metrics-tls: 100.260299ms since last change, 100.260226ms since last push, full=false 2026-09-10T02:57:25.763074Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:57:25Z/49 2026-09-10T02:57:28.302115Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {}, "outbound|8443||maas-controller-metrics.opendatahub.svc.cluster.local": {} } } 2026-09-10T02:57:28.899072Z info ads Push debounce stable[83] 7 for config ConfigMap/ai-tenants/kube-root-ca.crt and 3 more configs: 100.531882ms since last change, 141.52216ms since last push, full=false 2026-09-10T02:57:28.899166Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:57:25Z/49 2026-09-10T02:57:29.092174Z info model Full push, new service opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local 2026-09-10T02:57:29.093126Z info model Full push, new service opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local 2026-09-10T02:57:29.193307Z info ads Push debounce stable[84] 2 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.127666ms since last change, 101.054859ms since last push, full=true 2026-09-10T02:57:29.193878Z info ads XDS: Pushing Services:96 ConnectedEndpoints:2 Version:2026-09-10T02:57:29Z/50 2026-09-10T02:57:29.194667Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-10T02:57:29.194695Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:4 removed:0 size:2.5kB cached:0/2 2026-09-10T02:57:29.194806Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 2026-09-10T02:57:29.194971Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:2 removed:0 size:147B empty:0 cached:2/2 2026-09-10T02:57:29.195093Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:57:29.195197Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:57:29.195473Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-10T02:57:29.195591Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-10T02:57:29.195656Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-10T02:57:38.302531Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {}, "outbound|8443||maas-controller-metrics.opendatahub.svc.cluster.local": {} } } 2026-09-10T02:57:40.249456Z info ads Push debounce stable[85] 6 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.817314ms since last change, 143.953239ms since last push, full=false 2026-09-10T02:57:40.249556Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:57:29Z/50 2026-09-10T02:57:40.514215Z info ads Push debounce stable[86] 2 for config ServiceEntry/opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local and 1 more configs: 100.202184ms since last change, 100.205799ms since last push, full=false 2026-09-10T02:57:40.514268Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:57:29Z/50 2026-09-10T02:58:00.458313Z info ads Push debounce stable[87] 7 for config Secret/models-as-a-service/default-dockercfg-s29vz and 3 more configs: 100.261574ms since last change, 132.599479ms since last push, full=false 2026-09-10T02:58:00.458372Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:57:29Z/50 2026-09-10T02:58:01.746190Z info model Incremental push, service maas-api.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:58:01.768178Z info model Incremental push, service maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:58:01.905360Z info ads Push debounce stable[88] 5 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 2 more configs: 100.999063ms since last change, 166.714413ms since last push, full=true 2026-09-10T02:58:01.905901Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-09-10T02:58:01Z/51 2026-09-10T02:58:01.906449Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:4 removed:0 size:2.7kB cached:0/2 2026-09-10T02:58:01.906630Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:3 removed:0 size:2.3kB cached:0/2 2026-09-10T02:58:01.906729Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-10T02:58:01.906762Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-10T02:58:01.906793Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-10T02:58:01.906834Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T02:58:01.906871Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:01.906951Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:01.906987Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T02:58:01.912963Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 filtered:124 2026-09-10T02:58:01.914272Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 filtered:124 2026-09-10T02:58:02.134537Z info ads Push debounce stable[89] 4 for config Secret/odh-ai-gateway-infra/maas-api-dockercfg-vhkgd and 1 more configs: 100.484998ms since last change, 128.798187ms since last push, full=false 2026-09-10T02:58:02.134601Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:58:01Z/51 2026-09-10T02:58:02.400382Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:58:02.455659Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:58:02.694240Z info ads Push debounce stable[90] 15 for config DestinationRule/openshift-ingress/maas-api-backend-tls and 11 more configs: 100.052868ms since last change, 444.074177ms since last push, full=true 2026-09-10T02:58:02.697155Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T02:58:02Z/52 2026-09-10T02:58:02.698454Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:129 removed:0 size:149.2kB cached:118/128 2026-09-10T02:58:02.699038Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:126 removed:0 size:29.8kB empty:1 cached:125/126 2026-09-10T02:58:02.699310Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:02.699396Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:02.699429Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T02:58:02.701481Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:132 removed:0 size:149.7kB cached:0/128 2026-09-10T02:58:02.702128Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:126 removed:0 size:29.8kB empty:0 cached:126/126 2026-09-10T02:58:02.702362Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T02:58:02.702665Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T02:58:02.702697Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T02:58:02.711814Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:126 2026-09-10T02:58:02.715200Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:126 2026-09-10T02:58:03.221143Z info ads Push debounce stable[91] 1 for config EnvoyFilter/openshift-ingress/payload-processing: 100.690979ms since last change, 100.690894ms since last push, full=true 2026-09-10T02:58:03.222188Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T02:58:03Z/53 2026-09-10T02:58:03.223001Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-10T02:58:03.223046Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:132 removed:0 size:149.7kB cached:128/128 2026-09-10T02:58:03.223632Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-10T02:58:03.223642Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-10T02:58:03.223846Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:03.223854Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T02:58:03.223941Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:03.224074Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T02:58:06.285179Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-10T02:58:06.304632Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-10T02:58:06.404964Z info ads Push debounce stable[92] 2 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.2707ms since last change, 119.641742ms since last push, full=true 2026-09-10T02:58:06.405688Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T02:58:06Z/54 2026-09-10T02:58:06.406385Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-10T02:58:06.406453Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:6 removed:0 size:2.8kB cached:0/2 2026-09-10T02:58:06.406463Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 2026-09-10T02:58:06.406546Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 2026-09-10T02:58:06.406765Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:06.406861Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T02:58:06.406926Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:06.407176Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T02:58:06.918274Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-10T02:58:06.920764Z info model Full push, new service odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local 2026-09-10T02:58:07.021024Z info ads Push debounce stable[93] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.215092ms since last change, 102.695518ms since last push, full=true 2026-09-10T02:58:07.021582Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T02:58:07Z/55 2026-09-10T02:58:07.022185Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:3 removed:0 size:2.4kB cached:0/2 2026-09-10T02:58:07.022278Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 2026-09-10T02:58:07.022188Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:6 removed:0 size:3.0kB cached:0/2 2026-09-10T02:58:07.022416Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 2026-09-10T02:58:07.022542Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:07.022639Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:07.022694Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T02:58:07.022982Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T02:58:08.301628Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local": {}, "outbound|9090||maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local": {} } } 2026-09-10T02:58:11.903710Z info delta ADS: "10.134.0.29:47848" maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress-2 terminated 2026-09-10T02:58:12.961351Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-10T02:58:12.961382Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-10T02:58:12.996938Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-10T02:58:13.049769Z info ads Push debounce stable[94] 3 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 2 more configs: 100.567833ms since last change, 119.030778ms since last push, full=false 2026-09-10T02:58:13.049813Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-09-10T02:58:07Z/55 2026-09-10T02:58:13.100360Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress-3 2026-09-10T02:58:13.101145Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-10T02:58:13.175101Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 filtered:0 2026-09-10T02:58:13.267053Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T02:58:13.274541Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-10T02:58:13.274704Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-10T02:58:13.948589Z info ads Push debounce stable[95] 8 for config Secret/llm/builder-dockercfg-7qkq2 and 4 more configs: 100.228067ms since last change, 143.490634ms since last push, full=true 2026-09-10T02:58:13.948720Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T02:58:13Z/56 2026-09-10T02:58:13.949704Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:129 removed:0 size:149.2kB cached:124/128 2026-09-10T02:58:13.949720Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-10T02:58:13.950286Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 2026-09-10T02:58:13.950565Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:13.950632Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 2026-09-10T02:58:13.950646Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:13.950702Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T02:58:13.950938Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T02:58:13.951163Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T02:58:13.951204Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T02:58:14.891573Z info rootcertrotator Jitter complete, start rotator. 2026-09-10T02:58:17.412242Z info ads Push debounce stable[96] 2 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.208292ms since last change, 111.864156ms since last push, full=false 2026-09-10T02:58:17.412298Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:58:13Z/56 2026-09-10T02:58:18.302283Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T02:58:19.984740Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-10T02:58:19.985210Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:128 removed:0 size:30.2kB empty:0 cached:128/128 2026-09-10T02:58:19.985468Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T02:58:19.985733Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T02:58:19.985772Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T02:58:20.001402Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-10T02:58:20.001433Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-10T02:58:20.039946Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-10T02:58:20.088961Z info ads Push debounce stable[97] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.691839ms since last change, 100.691767ms since last push, full=false 2026-09-10T02:58:20.089012Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:58:13Z/56 2026-09-10T02:58:32.040432Z info ads Push debounce stable[98] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.21268ms since last change, 100.212615ms since last push, full=false 2026-09-10T02:58:32.040532Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:58:13Z/56 2026-09-10T02:58:32.253634Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:58:32.427212Z info ads Push debounce stable[99] 3 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.439959ms since last change, 181.441215ms since last push, full=true 2026-09-10T02:58:32.427795Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T02:58:32Z/57 2026-09-10T02:58:32.428405Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-10T02:58:32.428545Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-10T02:58:32.428714Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:32.428801Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:32.428831Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T02:58:32.429452Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T02:58:32.433860Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-10T02:58:32.436044Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-10T02:58:32.622164Z info ads Push debounce stable[100] 1 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc: 101.035779ms since last change, 101.035711ms since last push, full=true 2026-09-10T02:58:32.622330Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T02:58:32Z/58 2026-09-10T02:58:32.622887Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T02:58:32.622959Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T02:58:32.623701Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-10T02:58:32.623816Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:129 removed:0 size:30.6kB empty:1 cached:128/129 2026-09-10T02:58:32.624092Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:32.624151Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T02:58:32.624206Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:32.624669Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T02:58:32.947124Z info ads Push debounce stable[101] 3 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway and 1 more configs: 100.576158ms since last change, 146.643103ms since last push, full=true 2026-09-10T02:58:32.950653Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T02:58:32Z/59 2026-09-10T02:58:32.951626Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:130 removed:0 size:150.4kB cached:125/129 2026-09-10T02:58:32.952491Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-10T02:58:32.952747Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:32.952826Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:32.952857Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T02:58:32.954983Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:133 removed:0 size:151.0kB cached:0/129 2026-09-10T02:58:32.955466Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-10T02:58:32.955733Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-10T02:58:32.956042Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T02:58:32.956072Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T02:58:34.052795Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T02:58:34.153175Z info ads Push debounce stable[102] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.335086ms since last change, 100.335022ms since last push, full=true 2026-09-10T02:58:34.153768Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T02:58:34Z/60 2026-09-10T02:58:34.154304Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T02:58:34.154372Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-09-10T02:58:34.154304Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T02:58:34.154569Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-09-10T02:58:34.154767Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:34.154852Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:34.154873Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-10T02:58:34.155224Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T02:58:36.452849Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:58:36.635495Z info ads Push debounce stable[103] 5 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs and 3 more configs: 100.631483ms since last change, 208.267006ms since last push, full=true 2026-09-10T02:58:36.636136Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-10T02:58:36Z/61 2026-09-10T02:58:36.636681Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T02:58:36.636737Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T02:58:36.637350Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-10T02:58:36.637462Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-10T02:58:36.637662Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:36.637835Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:36.637880Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T02:58:36.637979Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-10T02:58:36.638529Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-10T02:58:36.638563Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T02:58:36.640968Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-10T02:58:36.641976Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-10T02:58:37.421881Z info ads Push debounce stable[104] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.209985ms since last change, 100.209917ms since last push, full=true 2026-09-10T02:58:37.426747Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-10T02:58:37Z/62 2026-09-10T02:58:37.427577Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:131 removed:0 size:151.5kB cached:130/130 2026-09-10T02:58:37.428246Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-10T02:58:37.428533Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:37.428642Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:37.430695Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-10T02:58:37.431279Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-10T02:58:37.431711Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T02:58:37.432222Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-10T02:58:38.301620Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T02:58:38.919359Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T02:58:39.019642Z info ads Push debounce stable[105] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.219694ms since last change, 100.219627ms since last push, full=true 2026-09-10T02:58:39.020217Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-10T02:58:39Z/63 2026-09-10T02:58:39.020852Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T02:58:39.020919Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T02:58:39.020932Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-10T02:58:39.020986Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-10T02:58:39.021186Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:39.021271Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:39.021526Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T02:58:39.022045Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-10T02:58:45.958846Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:58:46.076129Z info ads Push debounce stable[106] 4 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs and 2 more configs: 100.24133ms since last change, 148.562242ms since last push, full=true 2026-09-10T02:58:46.076740Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-10T02:58:46Z/64 2026-09-10T02:58:46.077256Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-10T02:58:46.077298Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-10T02:58:46.077572Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:46.077687Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:46.077740Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T02:58:46.077930Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T02:58:46.078571Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-10T02:58:46.078610Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T02:58:46.082762Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-10T02:58:46.082801Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-10T02:58:46.221722Z info ads Push debounce stable[107] 1 for config DestinationRule/llm/e2e-embedding-simulated-kserve-workload-svc: 100.221711ms since last change, 100.221643ms since last push, full=true 2026-09-10T02:58:46.221887Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-10T02:58:46Z/65 2026-09-10T02:58:46.222434Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T02:58:46.222471Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T02:58:46.223172Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:131 removed:0 size:30.8kB empty:1 cached:130/131 2026-09-10T02:58:46.223217Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T02:58:46.223566Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T02:58:46.223663Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:46.223849Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:46.224272Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-10T02:58:47.313532Z info ads Push debounce stable[108] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.710357ms since last change, 100.71027ms since last push, full=true 2026-09-10T02:58:47.324682Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-10T02:58:47Z/66 2026-09-10T02:58:47.325832Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:132 removed:0 size:152.7kB cached:131/131 2026-09-10T02:58:47.326530Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T02:58:47.326832Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:47.326946Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:47.330690Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-10T02:58:47.331358Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T02:58:47.331779Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-10T02:58:47.332446Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-10T02:58:48.302106Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T02:58:48.495383Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T02:58:48.595990Z info ads Push debounce stable[109] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.558066ms since last change, 100.558006ms since last push, full=true 2026-09-10T02:58:48.596601Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-10T02:58:48Z/67 2026-09-10T02:58:48.597163Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T02:58:48.597239Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-10T02:58:48.597165Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T02:58:48.597395Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-10T02:58:48.597588Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:48.597693Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:48.597856Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-10T02:58:48.598494Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-10T02:58:53.231711Z info ads Push debounce stable[110] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.170063ms since last change, 100.170001ms since last push, full=false 2026-09-10T02:58:53.231798Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:58:48Z/67 2026-09-10T02:58:53.442175Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:58:53.564548Z info ads Push debounce stable[111] 4 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local and 2 more configs: 100.464608ms since last change, 129.244483ms since last push, full=true 2026-09-10T02:58:53.565192Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-10T02:58:53Z/68 2026-09-10T02:58:53.565858Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T02:58:53.565904Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T02:58:53.566591Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T02:58:53.566601Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T02:58:53.567101Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:53.567143Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-10T02:58:53.567208Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:53.568319Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-10T02:58:53.570608Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-10T02:58:53.570851Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-10T02:58:55.013214Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T02:58:55.113404Z info ads Push debounce stable[112] 2 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway and 1 more configs: 100.042043ms since last change, 100.224382ms since last push, full=true 2026-09-10T02:58:55.121925Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-10T02:58:55Z/69 2026-09-10T02:58:55.122997Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:133 removed:0 size:153.9kB cached:131/132 2026-09-10T02:58:55.124039Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:132 removed:0 size:30.9kB empty:1 cached:131/132 2026-09-10T02:58:55.124267Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:58:55.124361Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:58:55.126413Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-10T02:58:55.126883Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:132 removed:0 size:30.9kB empty:0 cached:132/132 2026-09-10T02:58:55.127177Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T02:58:55.127895Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-10T02:58:56.645948Z info ads Push debounce stable[113] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.630494ms since last change, 100.630425ms since last push, full=false 2026-09-10T02:58:56.646021Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:58:55Z/69 2026-09-10T02:58:58.302365Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-10T02:59:02.467023Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:59:02.623613Z info ads Push debounce stable[114] 5 for config DestinationRule/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc and 3 more configs: 100.397125ms since last change, 193.997956ms since last push, full=true 2026-09-10T02:59:02.624224Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-10T02:59:02Z/70 2026-09-10T02:59:02.624806Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T02:59:02.624884Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T02:59:02.625434Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-10T02:59:02.625532Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-10T02:59:02.625729Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:59:02.625839Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:59:02.625887Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T02:59:02.625924Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T02:59:02.626988Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-10T02:59:02.627034Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T02:59:02.629047Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-10T02:59:02.630054Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-10T02:59:04.180488Z info ads Push debounce stable[115] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 101.048401ms since last change, 101.048337ms since last push, full=false 2026-09-10T02:59:04.180569Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:59:02Z/70 2026-09-10T02:59:04.204096Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T02:59:04.304366Z info ads Push debounce stable[116] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.217645ms since last change, 100.2176ms since last push, full=true 2026-09-10T02:59:04.304945Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-10T02:59:04Z/71 2026-09-10T02:59:04.305558Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T02:59:04.305629Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-09-10T02:59:04.305558Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T02:59:04.305781Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 2026-09-10T02:59:04.305981Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:59:04.306070Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:59:04.306083Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T02:59:04.307363Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-10T02:59:04.726839Z info ads Push debounce stable[117] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.221871ms since last change, 100.221802ms since last push, full=true 2026-09-10T02:59:04.736885Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-10T02:59:04Z/72 2026-09-10T02:59:04.737735Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:134 removed:0 size:155.2kB cached:131/133 2026-09-10T02:59:04.738237Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:133 removed:0 size:31.3kB empty:0 cached:133/133 2026-09-10T02:59:04.738463Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:59:04.738561Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:59:04.741306Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-10T02:59:04.741985Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:133 removed:0 size:31.3kB empty:0 cached:133/133 2026-09-10T02:59:04.742359Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-10T02:59:04.743379Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-10T02:59:08.302159Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T02:59:13.357848Z info ads Push debounce stable[118] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 101.074698ms since last change, 101.074631ms since last push, full=false 2026-09-10T02:59:13.357900Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:59:04Z/72 2026-09-10T02:59:21.664566Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:59:21.836091Z info ads Push debounce stable[119] 5 for config DestinationRule/llm/facebook-opt-125m-simulated-kserve-workload-svc and 3 more configs: 100.881149ms since last change, 212.116405ms since last push, full=true 2026-09-10T02:59:21.836808Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-10T02:59:21Z/73 2026-09-10T02:59:21.837304Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T02:59:21.837308Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T02:59:21.838128Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-10T02:59:21.838146Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-10T02:59:21.838949Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-10T02:59:21.839043Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:59:21.839371Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:59:21.839466Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T02:59:21.839865Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-10T02:59:21.839898Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T02:59:21.841623Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-10T02:59:21.841856Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-10T02:59:22.664962Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T02:59:22.765260Z info ads Push debounce stable[120] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.226746ms since last change, 100.226682ms since last push, full=true 2026-09-10T02:59:22.765864Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-10T02:59:22Z/74 2026-09-10T02:59:22.766446Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T02:59:22.766455Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T02:59:22.766548Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-10T02:59:22.766553Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 2026-09-10T02:59:22.766775Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:59:22.766862Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:59:22.767140Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-10T02:59:22.768181Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-10T02:59:24.433534Z info ads Push debounce stable[121] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.231754ms since last change, 100.231686ms since last push, full=true 2026-09-10T02:59:24.444969Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-10T02:59:24Z/75 2026-09-10T02:59:24.445856Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:135 removed:0 size:156.3kB cached:133/134 2026-09-10T02:59:24.446475Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T02:59:24.446848Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:59:24.446958Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:59:24.449083Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-10T02:59:24.449736Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T02:59:24.450187Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-10T02:59:24.451152Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-10T02:59:28.301687Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T02:59:31.152235Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T02:59:31.274790Z info ads Push debounce stable[122] 5 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs and 3 more configs: 100.277096ms since last change, 152.448587ms since last push, full=true 2026-09-10T02:59:31.275437Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-10T02:59:31Z/76 2026-09-10T02:59:31.275978Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T02:59:31.275979Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T02:59:31.276550Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T02:59:31.276692Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T02:59:31.276880Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:59:31.276989Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:59:31.277034Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T02:59:31.277118Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-10T02:59:31.278395Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-10T02:59:31.278439Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T02:59:31.280528Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-10T02:59:31.280833Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 filtered:134 2026-09-10T02:59:32.336816Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T02:59:32.437092Z info ads Push debounce stable[123] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.220239ms since last change, 100.22018ms since last push, full=true 2026-09-10T02:59:32.437755Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-10T02:59:32Z/77 2026-09-10T02:59:32.438331Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T02:59:32.438413Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-10T02:59:32.438542Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T02:59:32.438610Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-09-10T02:59:32.438707Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:59:32.438798Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:59:32.439083Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-10T02:59:32.440151Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-10T02:59:34.134768Z info ads Push debounce stable[124] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.225056ms since last change, 100.224998ms since last push, full=true 2026-09-10T02:59:34.148074Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-10T02:59:34Z/78 2026-09-10T02:59:34.148871Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:136 removed:0 size:157.6kB cached:135/135 2026-09-10T02:59:34.149348Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-10T02:59:34.149599Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T02:59:34.149683Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ggj4c.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T02:59:34.152217Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-10T02:59:34.152750Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-10T02:59:34.153162Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-10T02:59:34.154465Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-10T02:59:38.301793Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-s7n4k.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T02:59:49.529088Z info ads Push debounce stable[125] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.229658ms since last change, 100.229599ms since last push, full=false 2026-09-10T02:59:49.529166Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:59:34Z/78 2026-09-10T02:59:54.030007Z info ads Push debounce stable[126] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.219436ms since last change, 100.219383ms since last push, full=false 2026-09-10T02:59:54.030084Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:59:34Z/78 2026-09-10T03:00:05.133900Z info ads Push debounce stable[127] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.225389ms since last change, 100.225312ms since last push, full=false 2026-09-10T03:00:05.133956Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:59:34Z/78 2026-09-10T03:00:16.227126Z info ads Push debounce stable[128] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.212684ms since last change, 100.212616ms since last push, full=false 2026-09-10T03:00:16.227178Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:59:34Z/78 2026-09-10T03:00:41.922240Z info ads Push debounce stable[129] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.216192ms since last change, 100.216129ms since last push, full=false 2026-09-10T03:00:41.922303Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:59:34Z/78 2026-09-10T03:00:47.932542Z info ads Push debounce stable[130] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.225827ms since last change, 100.225773ms since last push, full=false 2026-09-10T03:00:47.932597Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:59:34Z/78 2026-09-10T03:00:58.330406Z info ads Push debounce stable[131] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.434692ms since last change, 100.434641ms since last push, full=false 2026-09-10T03:00:58.330454Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T02:59:34Z/78