2026-09-10T00:12:35.452269Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-10T00:12:35.452376Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:12:35.452456Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:12:43.813742Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {}, "outbound|8443||maas-controller-metrics.opendatahub.svc.cluster.local": {} } } 2026-09-10T00:12:46.496488Z info ads Push debounce stable[92] 6 for config ServiceEntry/opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local and 1 more configs: 101.072248ms since last change, 141.901128ms since last push, full=false 2026-09-10T00:12:46.496542Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:12:35Z/53 2026-09-10T00:12:46.754392Z info ads Push debounce stable[93] 2 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.195301ms since last change, 100.953452ms since last push, full=false 2026-09-10T00:12:46.754457Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:12:35Z/53 2026-09-10T00:13:06.671966Z info ads Push debounce stable[94] 7 for config Secret/models-as-a-service/default-dockercfg-fj5cb and 3 more configs: 100.030987ms since last change, 139.63411ms since last push, full=false 2026-09-10T00:13:06.672028Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:12:35Z/53 2026-09-10T00:13:08.028301Z info model Incremental push, service maas-api.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:13:08.116340Z info model Incremental push, service maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:13:08.217429Z info ads Push debounce stable[95] 4 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 101.044411ms since last change, 196.03939ms since last push, full=true 2026-09-10T00:13:08.217963Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-09-10T00:13:08Z/54 2026-09-10T00:13:08.218624Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:3 removed:0 size:2.3kB cached:0/2 2026-09-10T00:13:08.218677Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:4 removed:0 size:2.7kB cached:0/2 2026-09-10T00:13:08.218898Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:08.218927Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-10T00:13:08.218951Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-10T00:13:08.218984Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-10T00:13:08.218984Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:08.224844Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 filtered:124 2026-09-10T00:13:08.226301Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 filtered:124 2026-09-10T00:13:08.396910Z info ads Push debounce stable[96] 6 for config Secret/odh-ai-gateway-infra/maas-api-dockercfg-tcmgz and 3 more configs: 100.457703ms since last change, 175.522009ms since last push, full=false 2026-09-10T00:13:08.396962Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:13:08Z/54 2026-09-10T00:13:08.608171Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:13:08.665860Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:13:08.930219Z info ads Push debounce stable[97] 14 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 10 more configs: 100.076719ms since last change, 462.232366ms since last push, full=true 2026-09-10T00:13:08.932947Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T00:13:08Z/55 2026-09-10T00:13:08.934586Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:129 removed:0 size:149.2kB cached:118/128 2026-09-10T00:13:08.935213Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:126 removed:0 size:29.8kB empty:1 cached:125/126 2026-09-10T00:13:08.935493Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:08.935594Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:08.935644Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T00:13:08.937590Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:132 removed:0 size:149.7kB cached:0/128 2026-09-10T00:13:08.938103Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:126 removed:0 size:29.8kB empty:0 cached:126/126 2026-09-10T00:13:08.938349Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T00:13:08.939055Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T00:13:08.939201Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T00:13:08.951285Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:126 2026-09-10T00:13:08.951390Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:126 2026-09-10T00:13:09.380069Z info ads Push debounce stable[98] 1 for config EnvoyFilter/openshift-ingress/payload-processing: 100.374021ms since last change, 100.373958ms since last push, full=true 2026-09-10T00:13:09.381134Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T00:13:09Z/56 2026-09-10T00:13:09.381923Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:132 removed:0 size:149.7kB cached:128/128 2026-09-10T00:13:09.381924Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-10T00:13:09.382733Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-10T00:13:09.382733Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-10T00:13:09.383069Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T00:13:09.383231Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:09.383325Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:09.383441Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T00:13:12.224519Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-10T00:13:12.324815Z info ads Push debounce stable[99] 1 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local: 100.217642ms since last change, 100.217567ms since last push, full=true 2026-09-10T00:13:12.325389Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T00:13:12Z/57 2026-09-10T00:13:12.325989Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-09-10T00:13:12.325992Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.7kB cached:0/1 2026-09-10T00:13:12.326077Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:75B empty:1 cached:0/1 2026-09-10T00:13:12.326155Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:75B empty:0 cached:1/1 2026-09-10T00:13:12.326334Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:12.326381Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T00:13:12.326489Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:12.326645Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T00:13:13.556983Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-10T00:13:13.570549Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-10T00:13:13.575016Z info model Full push, new service odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local 2026-09-10T00:13:13.675699Z info ads Push debounce stable[100] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.647564ms since last change, 118.66444ms since last push, full=true 2026-09-10T00:13:13.676292Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T00:13:13Z/58 2026-09-10T00:13:13.677121Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:4 removed:0 size:3.5kB cached:0/3 2026-09-10T00:13:13.677163Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:7 removed:0 size:4.1kB cached:0/3 2026-09-10T00:13:13.677222Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:3 removed:0 size:207B empty:3 cached:0/3 2026-09-10T00:13:13.677239Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:3 removed:0 size:207B empty:1 cached:2/3 2026-09-10T00:13:13.677448Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:13.677474Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T00:13:13.677541Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:13.677747Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T00:13:13.813923Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local": {}, "outbound|9004||payload-processing.openshift-ingress.svc.cluster.local": {}, "outbound|9090||maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local": {} } } 2026-09-10T00:13:17.942345Z info delta ADS: "10.134.0.30:58900" maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress-2 terminated 2026-09-10T00:13:18.604573Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-10T00:13:18.604602Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-10T00:13:18.636388Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-10T00:13:18.693764Z info ads Push debounce stable[101] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.244516ms since last change, 100.244472ms since last push, full=false 2026-09-10T00:13:18.693834Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-09-10T00:13:13Z/58 2026-09-10T00:13:18.726619Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress-3 2026-09-10T00:13:18.727355Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-10T00:13:18.803532Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:128 removed:0 size:29.6kB empty:0 cached:128/128 filtered:0 2026-09-10T00:13:19.106163Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T00:13:19.113459Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-10T00:13:19.113527Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-10T00:13:19.673076Z info ads Push debounce stable[102] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.234073ms since last change, 103.013264ms since last push, full=false 2026-09-10T00:13:19.673165Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:13:13Z/58 2026-09-10T00:13:20.628870Z info ads Push debounce stable[103] 8 for config Gateway/openshift-ingress/maas-default-gateway-istio-autogenerated-k8s-gateway-https and 4 more configs: 100.92567ms since last change, 139.618069ms since last push, full=true 2026-09-10T00:13:20.629023Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T00:13:20Z/59 2026-09-10T00:13:20.629993Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:129 removed:0 size:149.2kB cached:124/128 2026-09-10T00:13:20.630125Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-10T00:13:20.630585Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 2026-09-10T00:13:20.630861Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 2026-09-10T00:13:20.630867Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:20.631108Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:20.631146Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T00:13:20.631251Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T00:13:20.631536Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T00:13:20.631566Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T00:13:23.336384Z info ads Push debounce stable[104] 1 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local: 100.16512ms since last change, 100.165048ms since last push, full=false 2026-09-10T00:13:23.336438Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:13:20Z/59 2026-09-10T00:13:23.813605Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T00:13:24.662539Z info ads Push debounce stable[105] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.065713ms since last change, 100.065625ms since last push, full=false 2026-09-10T00:13:24.662605Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:13:20Z/59 2026-09-10T00:13:24.802911Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-10T00:13:24.803378Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:128 removed:0 size:30.2kB empty:0 cached:128/128 2026-09-10T00:13:24.803630Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T00:13:24.803922Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T00:13:24.803957Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T00:13:24.820173Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-10T00:13:24.820203Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-10T00:13:24.850777Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-10T00:13:24.909779Z info ads Push debounce stable[106] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.77221ms since last change, 100.772152ms since last push, full=false 2026-09-10T00:13:24.909850Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:13:20Z/59 2026-09-10T00:13:32.313128Z info ads Push debounce stable[107] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.224561ms since last change, 100.22448ms since last push, full=false 2026-09-10T00:13:32.313180Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:13:20Z/59 2026-09-10T00:13:32.515159Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:13:32.633140Z info ads Push debounce stable[108] 3 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.864948ms since last change, 122.439409ms since last push, full=true 2026-09-10T00:13:32.633692Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T00:13:32Z/60 2026-09-10T00:13:32.634212Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-10T00:13:32.634212Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-10T00:13:32.634488Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T00:13:32.634787Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:32.634872Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:32.634936Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T00:13:32.639616Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-10T00:13:32.639908Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-10T00:13:32.806457Z info ads Push debounce stable[109] 1 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc: 100.249133ms since last change, 100.249062ms since last push, full=true 2026-09-10T00:13:32.806629Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T00:13:32Z/61 2026-09-10T00:13:32.807192Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T00:13:32.807192Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T00:13:32.807822Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:129 removed:0 size:30.7kB empty:1 cached:128/129 2026-09-10T00:13:32.808010Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-10T00:13:32.808147Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T00:13:32.808302Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:32.808447Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:32.808634Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T00:13:33.025445Z info ads Push debounce stable[110] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.355653ms since last change, 100.355587ms since last push, full=true 2026-09-10T00:13:33.028822Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T00:13:33Z/62 2026-09-10T00:13:33.030225Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:130 removed:0 size:150.4kB cached:125/129 2026-09-10T00:13:33.030955Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-10T00:13:33.031266Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:33.031379Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:33.033798Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:133 removed:0 size:151.0kB cached:0/129 2026-09-10T00:13:33.034656Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-10T00:13:33.035046Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-10T00:13:33.035520Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T00:13:33.271413Z info ads Push debounce stable[111] 2 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-lwb7s: 100.595053ms since last change, 134.343254ms since last push, full=false 2026-09-10T00:13:33.271492Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:13:33Z/62 2026-09-10T00:13:33.813979Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T00:13:34.111199Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T00:13:34.211476Z info ads Push debounce stable[112] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.213237ms since last change, 100.213154ms since last push, full=true 2026-09-10T00:13:34.211988Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T00:13:34Z/63 2026-09-10T00:13:34.212563Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T00:13:34.212578Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T00:13:34.212633Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-09-10T00:13:34.212634Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-09-10T00:13:34.212856Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:34.212954Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:34.213202Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-10T00:13:34.213621Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T00:13:35.813888Z info ads Push debounce stable[113] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.648837ms since last change, 100.648776ms since last push, full=false 2026-09-10T00:13:35.813954Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:13:34Z/63 2026-09-10T00:13:35.826470Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:13:35.946027Z info ads Push debounce stable[114] 4 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local and 2 more configs: 100.07919ms since last change, 125.875801ms since last push, full=true 2026-09-10T00:13:35.946644Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-10T00:13:35Z/64 2026-09-10T00:13:35.947210Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T00:13:35.947213Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T00:13:35.947889Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-10T00:13:35.947899Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-10T00:13:35.948212Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:35.948316Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:35.948444Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-10T00:13:35.948958Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-10T00:13:35.951344Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-10T00:13:35.951423Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-10T00:13:36.733262Z info ads Push debounce stable[115] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.227785ms since last change, 100.227685ms since last push, full=true 2026-09-10T00:13:36.738064Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-10T00:13:36Z/65 2026-09-10T00:13:36.739365Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:131 removed:0 size:151.5kB cached:130/130 2026-09-10T00:13:36.739900Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-10T00:13:36.740569Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:36.740701Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:36.747699Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-10T00:13:36.748218Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-10T00:13:36.748496Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T00:13:36.749013Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-10T00:13:38.362528Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T00:13:38.462804Z info ads Push debounce stable[116] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.212718ms since last change, 100.212652ms since last push, full=true 2026-09-10T00:13:38.463399Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-10T00:13:38Z/66 2026-09-10T00:13:38.463948Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T00:13:38.463981Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T00:13:38.464013Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-10T00:13:38.464041Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-10T00:13:38.464274Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:38.464361Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:38.464532Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T00:13:38.465042Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-10T00:13:43.548910Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:13:43.729927Z info ads Push debounce stable[117] 5 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs and 3 more configs: 100.065397ms since last change, 206.024224ms since last push, full=true 2026-09-10T00:13:43.730584Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-10T00:13:43Z/67 2026-09-10T00:13:43.731200Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T00:13:43.731249Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T00:13:43.731820Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-10T00:13:43.731942Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-10T00:13:43.732138Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:43.732253Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:43.732299Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T00:13:43.732507Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T00:13:43.733304Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-10T00:13:43.733342Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T00:13:43.735334Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-10T00:13:43.735988Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-10T00:13:43.813492Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-10T00:13:45.235354Z info ads Push debounce stable[118] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.15932ms since last change, 100.159246ms since last push, full=true 2026-09-10T00:13:45.242009Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-10T00:13:45Z/68 2026-09-10T00:13:45.242890Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:132 removed:0 size:152.7kB cached:131/131 2026-09-10T00:13:45.243552Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T00:13:45.243900Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:45.244014Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:45.245964Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-10T00:13:45.246467Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T00:13:45.246760Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-10T00:13:45.247417Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-10T00:13:45.718579Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T00:13:45.818952Z info ads Push debounce stable[119] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.226865ms since last change, 100.226768ms since last push, full=true 2026-09-10T00:13:45.819539Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-10T00:13:45Z/69 2026-09-10T00:13:45.820153Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T00:13:45.820193Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T00:13:45.820243Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-10T00:13:45.820250Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-10T00:13:45.820501Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:45.820646Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:45.820776Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-10T00:13:45.821490Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-10T00:13:52.418608Z info ads Push debounce stable[120] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.811067ms since last change, 100.810993ms since last push, full=false 2026-09-10T00:13:52.418740Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:13:45Z/69 2026-09-10T00:13:52.425038Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:13:52.608748Z info ads Push debounce stable[121] 4 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 2 more configs: 100.962596ms since last change, 189.935082ms since last push, full=true 2026-09-10T00:13:52.609385Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-10T00:13:52Z/70 2026-09-10T00:13:52.609903Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T00:13:52.609903Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T00:13:52.610552Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T00:13:52.610676Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T00:13:52.610786Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:52.610936Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:52.611160Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-10T00:13:52.611979Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-10T00:13:52.613978Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-10T00:13:52.614217Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-10T00:13:53.205049Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T00:13:53.305389Z info ads Push debounce stable[122] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.21694ms since last change, 100.216872ms since last push, full=true 2026-09-10T00:13:53.305957Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-10T00:13:53Z/71 2026-09-10T00:13:53.306546Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T00:13:53.306641Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-10T00:13:53.306691Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T00:13:53.306748Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-10T00:13:53.306932Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:53.307116Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:53.307184Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-10T00:13:53.307930Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-10T00:13:53.813676Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-10T00:13:54.142861Z info ads Push debounce stable[123] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.591596ms since last change, 100.591535ms since last push, full=true 2026-09-10T00:13:54.151056Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-10T00:13:54Z/72 2026-09-10T00:13:54.152105Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:133 removed:0 size:153.9kB cached:132/132 2026-09-10T00:13:54.152836Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:132 removed:0 size:30.9kB empty:0 cached:132/132 2026-09-10T00:13:54.153133Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:13:54.153224Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:13:54.155519Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-10T00:13:54.155932Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:132 removed:0 size:30.9kB empty:0 cached:132/132 2026-09-10T00:13:54.156246Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T00:13:54.156925Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-10T00:13:54.871536Z info ads Push debounce stable[124] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.400673ms since last change, 100.400607ms since last push, full=false 2026-09-10T00:13:54.871607Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:13:54Z/72 2026-09-10T00:14:01.753105Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:14:01.866618Z info ads Push debounce stable[125] 4 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs and 2 more configs: 100.889594ms since last change, 156.565438ms since last push, full=true 2026-09-10T00:14:01.867226Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-10T00:14:01Z/73 2026-09-10T00:14:01.867800Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.5kB cached:0/1 2026-09-10T00:14:01.867875Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:2.1kB cached:0/1 2026-09-10T00:14:01.868052Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:14:01.868171Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:14:01.868217Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T00:14:01.868788Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T00:14:01.869753Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-10T00:14:01.869788Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T00:14:01.873466Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-10T00:14:01.873503Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-10T00:14:02.010250Z info ads Push debounce stable[126] 1 for config DestinationRule/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc: 100.212979ms since last change, 100.212912ms since last push, full=true 2026-09-10T00:14:02.010448Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-10T00:14:02Z/74 2026-09-10T00:14:02.010988Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T00:14:02.010991Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T00:14:02.011640Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:133 removed:0 size:31.2kB empty:1 cached:132/133 2026-09-10T00:14:02.011763Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-10T00:14:02.011917Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:14:02.012030Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:14:02.012194Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T00:14:02.013138Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-10T00:14:03.261286Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T00:14:03.375889Z info ads Push debounce stable[127] 2 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.563864ms since last change, 114.469797ms since last push, full=true 2026-09-10T00:14:03.376507Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-10T00:14:03Z/75 2026-09-10T00:14:03.377145Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:6 removed:0 size:3.1kB cached:0/2 2026-09-10T00:14:03.377247Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:2 removed:0 size:345B empty:1 cached:0/2 2026-09-10T00:14:03.377144Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:3 removed:0 size:2.5kB cached:0/2 2026-09-10T00:14:03.377364Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:345B empty:0 cached:2/2 2026-09-10T00:14:03.377604Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:14:03.377689Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:14:03.377714Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T00:14:03.378683Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-10T00:14:03.813448Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-10T00:14:03.948979Z info ads Push debounce stable[128] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.220975ms since last change, 100.220904ms since last push, full=true 2026-09-10T00:14:03.960575Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-10T00:14:03Z/76 2026-09-10T00:14:03.965077Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:134 removed:0 size:155.2kB cached:132/133 2026-09-10T00:14:03.965774Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:133 removed:0 size:31.3kB empty:0 cached:133/133 2026-09-10T00:14:03.965998Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:14:03.966111Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:14:03.966776Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-10T00:14:03.967408Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:133 removed:0 size:31.3kB empty:0 cached:133/133 2026-09-10T00:14:03.967723Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-10T00:14:03.968561Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-10T00:14:12.416264Z info ads Push debounce stable[129] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.392326ms since last change, 100.392274ms since last push, full=false 2026-09-10T00:14:12.416335Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:14:03Z/76 2026-09-10T00:14:13.528818Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:14:13.715706Z info ads Push debounce stable[130] 5 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs and 3 more configs: 100.059256ms since last change, 291.315012ms since last push, full=true 2026-09-10T00:14:13.716381Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-10T00:14:13Z/77 2026-09-10T00:14:13.716863Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T00:14:13.716866Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T00:14:13.717558Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-10T00:14:13.717628Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-10T00:14:13.717790Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:14:13.717878Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:14:13.717928Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T00:14:13.718415Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-10T00:14:13.719633Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-10T00:14:13.719668Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T00:14:13.721032Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-10T00:14:13.721157Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-10T00:14:13.813569Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-10T00:14:14.561127Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T00:14:14.661469Z info ads Push debounce stable[131] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.216ms since last change, 100.215927ms since last push, full=true 2026-09-10T00:14:14.662034Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-10T00:14:14Z/78 2026-09-10T00:14:14.662658Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T00:14:14.662705Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T00:14:14.662731Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-10T00:14:14.662787Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 2026-09-10T00:14:14.663005Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:14:14.663141Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:14:14.663348Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-10T00:14:14.665392Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-10T00:14:16.054054Z info ads Push debounce stable[132] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.230747ms since last change, 100.230666ms since last push, full=true 2026-09-10T00:14:16.065811Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-10T00:14:16Z/79 2026-09-10T00:14:16.066819Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:135 removed:0 size:156.3kB cached:133/134 2026-09-10T00:14:16.067339Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T00:14:16.067571Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:14:16.067689Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:14:16.070928Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-10T00:14:16.071619Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T00:14:16.072078Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-10T00:14:16.073612Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-10T00:14:20.437629Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T00:14:20.623535Z info ads Push debounce stable[133] 5 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs and 3 more configs: 100.862456ms since last change, 210.871873ms since last push, full=true 2026-09-10T00:14:20.624222Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-10T00:14:20Z/80 2026-09-10T00:14:20.624839Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T00:14:20.624907Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T00:14:20.625576Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T00:14:20.625580Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T00:14:20.625898Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:14:20.625969Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-10T00:14:20.626009Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:14:20.626050Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T00:14:20.627112Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-10T00:14:20.627159Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T00:14:20.629034Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-10T00:14:20.629425Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 filtered:134 2026-09-10T00:14:21.601653Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T00:14:21.702665Z info ads Push debounce stable[134] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.95848ms since last change, 100.958418ms since last push, full=true 2026-09-10T00:14:21.703243Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-10T00:14:21Z/81 2026-09-10T00:14:21.703844Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T00:14:21.703940Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-10T00:14:21.703991Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T00:14:21.704049Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-09-10T00:14:21.704329Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:14:21.704535Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:14:21.704538Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-10T00:14:21.706053Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-10T00:14:23.813668Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-10T00:14:24.276975Z info ads Push debounce stable[135] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.224657ms since last change, 100.224534ms since last push, full=true 2026-09-10T00:14:24.290444Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-10T00:14:24Z/82 2026-09-10T00:14:24.291468Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:136 removed:0 size:157.6kB cached:135/135 2026-09-10T00:14:24.291966Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-10T00:14:24.292283Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T00:14:24.292409Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T00:14:24.294573Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-10T00:14:24.295058Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-10T00:14:24.295716Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-10T00:14:24.296793Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-10T00:14:31.016444Z info ads Push debounce stable[136] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.225444ms since last change, 100.225373ms since last push, full=false 2026-09-10T00:14:31.016495Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:14:24Z/82 2026-09-10T00:14:33.813375Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-g2vbx.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T00:14:36.614133Z info ads Push debounce stable[137] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.760164ms since last change, 100.760058ms since last push, full=false 2026-09-10T00:14:36.614183Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:14:24Z/82 2026-09-10T00:14:40.320490Z info ads Push debounce stable[138] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.216761ms since last change, 100.21669ms since last push, full=false 2026-09-10T00:14:40.320541Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:14:24Z/82 2026-09-10T00:14:49.714838Z info ads Push debounce stable[139] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.217758ms since last change, 100.217675ms since last push, full=false 2026-09-10T00:14:49.714890Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:14:24Z/82 2026-09-10T00:14:57.017239Z info ads Push debounce stable[140] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.317717ms since last change, 100.317661ms since last push, full=false 2026-09-10T00:14:57.017289Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:14:24Z/82 2026-09-10T00:14:59.417463Z info ads Push debounce stable[141] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.277068ms since last change, 100.277004ms since last push, full=false 2026-09-10T00:14:59.417536Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:14:24Z/82 2026-09-10T00:15:02.417746Z info ads Push debounce stable[142] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.226346ms since last change, 100.226265ms since last push, full=false 2026-09-10T00:15:02.417805Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T00:14:24Z/82