2026-09-09T23:31:22.821449Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:4 removed:0 size:2.5kB cached:0/2 2026-09-09T23:31:22.821578Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:31:22.821651Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T23:31:22.821674Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:31:22.821676Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T23:31:22.821800Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T23:31:22.826746Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 filtered:122 2026-09-09T23:31:22.826873Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:2 removed:0 size:147B empty:0 cached:2/2 filtered:122 2026-09-09T23:31:23.175434Z info ads Push debounce stable[84] 1 for config Secret/opendatahub/maas-controller-webhook-cert: 100.063521ms since last change, 100.063454ms since last push, full=false 2026-09-09T23:31:23.175510Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:31:22Z/52 2026-09-09T23:31:23.527356Z info ads Push debounce stable[85] 1 for config Secret/opendatahub/maas-controller-metrics-tls: 100.925215ms since last change, 100.92515ms since last push, full=false 2026-09-09T23:31:23.527424Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:31:22Z/52 2026-09-09T23:31:26.872831Z info ads Push debounce stable[86] 7 for config Secret/ai-tenants/builder-dockercfg-v7vd5 and 3 more configs: 100.764211ms since last change, 141.788381ms since last push, full=false 2026-09-09T23:31:26.872895Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:31:22Z/52 2026-09-09T23:31:27.093476Z info model Full push, new service opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local 2026-09-09T23:31:27.093536Z info model Full push, new service opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local 2026-09-09T23:31:27.193668Z info ads Push debounce stable[87] 2 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.093115ms since last change, 100.096528ms since last push, full=true 2026-09-09T23:31:27.194202Z info ads XDS: Pushing Services:96 ConnectedEndpoints:2 Version:2026-09-09T23:31:27Z/53 2026-09-09T23:31:27.194804Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:4 removed:0 size:2.5kB cached:0/2 2026-09-09T23:31:27.194864Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-09T23:31:27.194883Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 2026-09-09T23:31:27.194936Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:147B empty:0 cached:2/2 2026-09-09T23:31:27.195123Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T23:31:27.195141Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:31:27.195149Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T23:31:27.195179Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T23:31:27.195226Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:31:30.483686Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {}, "outbound|8443||maas-controller-metrics.opendatahub.svc.cluster.local": {} } } 2026-09-09T23:31:38.233936Z info ads Push debounce stable[88] 6 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.160444ms since last change, 134.45803ms since last push, full=false 2026-09-09T23:31:38.233990Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:31:27Z/53 2026-09-09T23:31:38.487830Z info ads Push debounce stable[89] 2 for config ServiceEntry/opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local and 1 more configs: 100.218699ms since last change, 100.2224ms since last push, full=false 2026-09-09T23:31:38.487885Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:31:27Z/53 2026-09-09T23:31:55.399325Z info ads Push debounce stable[90] 7 for config ConfigMap/models-as-a-service/kube-root-ca.crt and 3 more configs: 101.06943ms since last change, 142.201048ms since last push, full=false 2026-09-09T23:31:55.399425Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:31:27Z/53 2026-09-09T23:31:56.956300Z info model Incremental push, service maas-api.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:31:56.981619Z info model Incremental push, service maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:31:57.184643Z info ads Push debounce stable[91] 8 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 3 more configs: 100.807515ms since last change, 234.516175ms since last push, full=true 2026-09-09T23:31:57.185175Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-09-09T23:31:57Z/54 2026-09-09T23:31:57.185736Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:3 removed:0 size:2.3kB cached:0/2 2026-09-09T23:31:57.185912Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:4 removed:0 size:2.7kB cached:0/2 2026-09-09T23:31:57.186045Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:31:57.186172Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T23:31:57.186202Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T23:31:57.186228Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T23:31:57.186235Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:31:57.186270Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:31:57.186278Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:31:57.191846Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 filtered:124 2026-09-09T23:31:57.192041Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 filtered:124 2026-09-09T23:31:57.377951Z info ads Push debounce stable[92] 2 for config Secret/odh-ai-gateway-infra/maas-api-metrics-tls and 1 more configs: 100.286467ms since last change, 109.996149ms since last push, full=false 2026-09-09T23:31:57.378013Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:31:57Z/54 2026-09-09T23:31:57.548516Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:31:57.598286Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:31:57.788566Z info ads Push debounce stable[93] 14 for config DestinationRule/openshift-ingress/maas-api-backend-tls and 10 more configs: 100.359566ms since last change, 385.522679ms since last push, full=true 2026-09-09T23:31:57.791380Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:31:57Z/55 2026-09-09T23:31:57.792803Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:129 removed:0 size:149.2kB cached:118/128 2026-09-09T23:31:57.793464Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:126 removed:0 size:29.8kB empty:1 cached:125/126 2026-09-09T23:31:57.793700Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:31:57.793795Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:31:57.793845Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:31:57.795678Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:132 removed:0 size:149.7kB cached:0/128 2026-09-09T23:31:57.796265Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:126 removed:0 size:29.8kB empty:0 cached:126/126 2026-09-09T23:31:57.796535Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:31:57.796806Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:31:57.796844Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:31:57.805286Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:126 2026-09-09T23:31:57.810166Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:126 2026-09-09T23:31:58.302301Z info ads Push debounce stable[94] 1 for config EnvoyFilter/openshift-ingress/payload-processing: 100.384678ms since last change, 100.384605ms since last push, full=true 2026-09-09T23:31:58.303275Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:31:58Z/56 2026-09-09T23:31:58.304066Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T23:31:58.304121Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:132 removed:0 size:149.7kB cached:128/128 2026-09-09T23:31:58.304662Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:31:58.304817Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:31:58.304916Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:31:58.305017Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:31:58.305098Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:31:58.305428Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:32:00.231413Z info model Full push, new service odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T23:32:00.234128Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T23:32:00.334721Z info ads Push debounce stable[95] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.476773ms since last change, 103.23587ms since last push, full=true 2026-09-09T23:32:00.335345Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:32:00Z/57 2026-09-09T23:32:00.335995Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:3 removed:0 size:2.4kB cached:0/2 2026-09-09T23:32:00.336011Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:6 removed:0 size:3.0kB cached:0/2 2026-09-09T23:32:00.336094Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 2026-09-09T23:32:00.336279Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:2 removed:0 size:136B empty:1 cached:1/2 2026-09-09T23:32:00.336385Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:00.336498Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:00.336692Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:32:00.337026Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:32:00.489435Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local": {}, "outbound|9090||maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local": {} } } 2026-09-09T23:32:01.110002Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-09T23:32:01.127962Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-09T23:32:01.228071Z info ads Push debounce stable[96] 2 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.058714ms since last change, 117.948741ms since last push, full=true 2026-09-09T23:32:01.228650Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:32:01Z/58 2026-09-09T23:32:01.229254Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-09T23:32:01.229261Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:6 removed:0 size:2.8kB cached:0/2 2026-09-09T23:32:01.229360Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 2026-09-09T23:32:01.229461Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:146B empty:1 cached:1/2 2026-09-09T23:32:01.229625Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:32:01.229770Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:01.229863Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:01.229948Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:32:06.345715Z info ads Push debounce stable[97] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.72782ms since last change, 100.732556ms since last push, full=false 2026-09-09T23:32:06.345798Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:32:01Z/58 2026-09-09T23:32:06.988808Z info delta ADS: "10.134.0.37:33696" maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress-2 terminated 2026-09-09T23:32:07.190996Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:32:07.191025Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:32:07.230652Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:32:07.291346Z info ads Push debounce stable[98] 9 for config Secret/llm/default-dockercfg-vbsg8 and 5 more configs: 100.466166ms since last change, 160.061522ms since last push, full=true 2026-09-09T23:32:07.291874Z info ads XDS: Pushing Services:100 ConnectedEndpoints:1 Version:2026-09-09T23:32:07Z/59 2026-09-09T23:32:07.293030Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:129 removed:0 size:149.2kB cached:124/128 2026-09-09T23:32:07.293559Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:128 removed:0 size:29.9kB empty:2 cached:126/128 2026-09-09T23:32:07.293936Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:07.294057Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:07.294100Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:32:07.295271Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress-3 2026-09-09T23:32:07.296029Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-09T23:32:07.372217Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 filtered:0 2026-09-09T23:32:07.454201Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:32:07.461105Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-09T23:32:07.461624Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-09T23:32:10.489414Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|15021||maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local": {}, "outbound|443||maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local": {} } } 2026-09-09T23:32:12.250559Z info ads Push debounce stable[99] 2 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.791347ms since last change, 121.003068ms since last push, full=false 2026-09-09T23:32:12.250639Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:32:07Z/59 2026-09-09T23:32:12.624363Z info ads Push debounce stable[100] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.215231ms since last change, 100.215156ms since last push, full=false 2026-09-09T23:32:12.624429Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:32:07Z/59 2026-09-09T23:32:12.755108Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:32:12.883375Z info ads Push debounce stable[101] 3 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 1 more configs: 101.977338ms since last change, 135.850346ms since last push, full=true 2026-09-09T23:32:12.884204Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:32:12Z/60 2026-09-09T23:32:12.885032Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T23:32:12.885468Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:32:12.885612Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T23:32:12.885918Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:12.886037Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:12.886238Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:32:12.895246Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-09T23:32:13.109642Z info ads Push debounce stable[102] 1 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc: 100.209125ms since last change, 100.209056ms since last push, full=true 2026-09-09T23:32:13.109805Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:32:13Z/61 2026-09-09T23:32:13.110555Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:32:13.110559Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:32:13.111392Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:129 removed:0 size:30.2kB empty:1 cached:128/129 2026-09-09T23:32:13.111406Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:128 removed:0 size:30.2kB empty:0 cached:128/128 2026-09-09T23:32:13.111662Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:13.111684Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:32:13.111825Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:13.112410Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:32:13.185924Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-09T23:32:13.225811Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:133 removed:0 size:151.0kB cached:123/129 2026-09-09T23:32:13.226563Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:129 removed:0 size:30.2kB empty:0 cached:129/129 2026-09-09T23:32:13.226883Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:32:13.227276Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:32:13.227334Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:32:13.229969Z info ads Push debounce stable[103] 2 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-rs8q4: 100.970397ms since last change, 111.544947ms since last push, full=false 2026-09-09T23:32:13.230003Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:32:13Z/61 2026-09-09T23:32:13.244277Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:32:13.244301Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:32:13.285833Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:32:13.331940Z info ads Push debounce stable[104] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.370202ms since last change, 100.370075ms since last push, full=false 2026-09-09T23:32:13.331995Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:32:13Z/61 2026-09-09T23:32:13.476345Z info ads Push debounce stable[105] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.672781ms since last change, 100.672707ms since last push, full=true 2026-09-09T23:32:13.479637Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:32:13Z/62 2026-09-09T23:32:13.480957Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:130 removed:0 size:150.4kB cached:125/129 2026-09-09T23:32:13.481582Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-09T23:32:13.481869Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:13.481970Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:13.484493Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:133 removed:0 size:151.0kB cached:0/129 2026-09-09T23:32:13.485168Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-09T23:32:13.485569Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:32:13.485942Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:32:15.210170Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:32:15.310438Z info ads Push debounce stable[106] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.220205ms since last change, 100.22012ms since last push, full=true 2026-09-09T23:32:15.310985Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:32:15Z/63 2026-09-09T23:32:15.311564Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:32:15.311614Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:32:15.311634Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-09-09T23:32:15.311674Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-09-09T23:32:15.311889Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:15.312002Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:15.312102Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:32:15.312474Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:32:19.438483Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:32:19.573557Z info ads Push debounce stable[107] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.261691ms since last change, 162.02509ms since last push, full=true 2026-09-09T23:32:19.574145Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:32:19Z/64 2026-09-09T23:32:19.574697Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:32:19.574712Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:32:19.575530Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-09T23:32:19.575560Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-09T23:32:19.575921Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:32:19.575967Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:19.576062Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:19.576104Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:32:19.576566Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:32:19.576614Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:32:19.579261Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-09T23:32:19.579705Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-09T23:32:20.390972Z info ads Push debounce stable[108] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.223968ms since last change, 100.223916ms since last push, full=true 2026-09-09T23:32:20.396030Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:32:20Z/65 2026-09-09T23:32:20.397047Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:131 removed:0 size:151.5kB cached:130/130 2026-09-09T23:32:20.397827Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:32:20.398105Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:20.398211Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:20.400210Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-09T23:32:20.400891Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:32:20.401235Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:32:20.401788Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:32:20.483929Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:32:21.325698Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:32:21.426352Z info ads Push debounce stable[109] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.50562ms since last change, 100.50554ms since last push, full=true 2026-09-09T23:32:21.426877Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:32:21Z/66 2026-09-09T23:32:21.427458Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:32:21.427534Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-09T23:32:21.427461Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:32:21.427749Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-09T23:32:21.428009Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:21.428117Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:21.428126Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:32:21.428791Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:32:28.353617Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:32:28.528687Z info ads Push debounce stable[110] 5 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs and 3 more configs: 101.016355ms since last change, 212.174382ms since last push, full=true 2026-09-09T23:32:28.529296Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:32:28Z/67 2026-09-09T23:32:28.529846Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:32:28.529933Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:32:28.530530Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:32:28.530600Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:32:28.530800Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:28.530958Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:28.531036Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:32:28.531040Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:32:28.531979Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:32:28.532028Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:32:28.534657Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-09T23:32:28.534806Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-09T23:32:29.788356Z info ads Push debounce stable[111] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.233614ms since last change, 100.233542ms since last push, full=true 2026-09-09T23:32:29.794892Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:32:29Z/68 2026-09-09T23:32:29.795866Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:132 removed:0 size:152.7kB cached:131/131 2026-09-09T23:32:29.796382Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:32:29.796637Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:29.796754Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:29.799089Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-09T23:32:29.799637Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:32:29.799963Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:32:29.800554Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:32:30.166946Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:32:30.267045Z info ads Push debounce stable[112] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.053371ms since last change, 100.053312ms since last push, full=true 2026-09-09T23:32:30.267571Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:32:30Z/69 2026-09-09T23:32:30.268128Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:32:30.268216Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T23:32:30.268131Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:32:30.268359Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-09T23:32:30.268687Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:30.268739Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:32:30.268808Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:30.269437Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:32:30.483666Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:32:38.660577Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:32:38.822283Z info ads Push debounce stable[113] 5 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs and 3 more configs: 100.881829ms since last change, 200.414643ms since last push, full=true 2026-09-09T23:32:38.822895Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:32:38Z/70 2026-09-09T23:32:38.823455Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:32:38.823480Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:32:38.824209Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:32:38.824347Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:32:38.824549Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:38.824719Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:38.824766Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:32:38.824718Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:32:38.825941Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:32:38.825988Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:32:38.828043Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-09T23:32:38.828382Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-09T23:32:39.317112Z info ads Push debounce stable[114] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.33551ms since last change, 100.335444ms since last push, full=false 2026-09-09T23:32:39.317169Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:32:38Z/70 2026-09-09T23:32:40.210369Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:32:40.310739Z info ads Push debounce stable[115] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.312478ms since last change, 100.312409ms since last push, full=true 2026-09-09T23:32:40.311293Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:32:40Z/71 2026-09-09T23:32:40.311985Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:32:40.311991Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:32:40.312096Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T23:32:40.312176Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-09T23:32:40.312501Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:40.312605Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:40.312781Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:32:40.313827Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:32:40.484214Z info ads Push debounce stable[116] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.932788ms since last change, 100.932736ms since last push, full=true 2026-09-09T23:32:40.492352Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:32:40Z/72 2026-09-09T23:32:40.493328Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:133 removed:0 size:153.9kB cached:131/132 2026-09-09T23:32:40.493917Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T23:32:40.494186Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:40.494285Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:40.496298Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-09T23:32:40.496814Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T23:32:40.497211Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:32:40.498163Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:32:46.221356Z info ads Push debounce stable[117] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.638468ms since last change, 100.638366ms since last push, full=false 2026-09-09T23:32:46.221419Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:32:40Z/72 2026-09-09T23:32:46.229980Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:32:46.349856Z info ads Push debounce stable[118] 4 for config DestinationRule/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc and 2 more configs: 100.681553ms since last change, 128.250761ms since last push, full=true 2026-09-09T23:32:46.350488Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:32:46Z/73 2026-09-09T23:32:46.351001Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:32:46.351006Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:32:46.351716Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T23:32:46.351765Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T23:32:46.352027Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:46.352152Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:46.352261Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:32:46.353197Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:32:46.356380Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-09T23:32:46.356530Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-09T23:32:47.391901Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:32:47.492048Z info ads Push debounce stable[119] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.093552ms since last change, 100.093503ms since last push, full=true 2026-09-09T23:32:47.492647Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:32:47Z/74 2026-09-09T23:32:47.493252Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:32:47.493341Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-09-09T23:32:47.493354Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:32:47.493417Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 2026-09-09T23:32:47.493607Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:47.494141Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:47.495787Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:32:47.499946Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:32:48.108542Z info ads Push debounce stable[120] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.463404ms since last change, 100.463343ms since last push, full=true 2026-09-09T23:32:48.118491Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:32:48Z/75 2026-09-09T23:32:48.119490Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:134 removed:0 size:155.2kB cached:133/133 2026-09-09T23:32:48.120166Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T23:32:48.120549Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:48.120673Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:48.122685Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-09T23:32:48.123173Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T23:32:48.123697Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:32:48.124635Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:32:49.367486Z info ads Push debounce stable[121] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 101.032595ms since last change, 101.032535ms since last push, full=false 2026-09-09T23:32:49.367578Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:32:48Z/75 2026-09-09T23:32:50.484190Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:32:57.566654Z info ads Push debounce stable[122] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 101.00479ms since last change, 101.004726ms since last push, full=false 2026-09-09T23:32:57.566724Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:32:48Z/75 2026-09-09T23:32:58.948955Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:32:59.129958Z info ads Push debounce stable[123] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.791982ms since last change, 210.967489ms since last push, full=true 2026-09-09T23:32:59.130654Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:32:59Z/76 2026-09-09T23:32:59.131261Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:32:59.131343Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:32:59.132158Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-09T23:32:59.132158Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-09T23:32:59.132633Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:32:59.132677Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:32:59.132782Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:32:59.132866Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:32:59.133765Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:32:59.133801Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:32:59.136055Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-09T23:32:59.136544Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-09T23:33:00.483660Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:33:00.518635Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:33:00.619821Z info ads Push debounce stable[124] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 101.060706ms since last change, 101.060646ms since last push, full=true 2026-09-09T23:33:00.620442Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:33:00Z/77 2026-09-09T23:33:00.621029Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:33:00.621081Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:33:00.621119Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-09T23:33:00.621133Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 2026-09-09T23:33:00.621551Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:33:00.621664Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:33:00.621671Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:33:00.622789Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:33:01.298902Z info ads Push debounce stable[125] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.215139ms since last change, 100.215083ms since last push, full=true 2026-09-09T23:33:01.310530Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:33:01Z/78 2026-09-09T23:33:01.311878Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:135 removed:0 size:156.3kB cached:132/134 2026-09-09T23:33:01.312546Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:33:01.312851Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:33:01.312962Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:33:01.315352Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-09T23:33:01.315876Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:33:01.316218Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:33:01.317394Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:33:10.483851Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:33:15.290370Z info model Incremental push, service kserve-controller-manager-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:33:15.390644Z info ads Push debounce stable[126] 1 for config ServiceEntry/opendatahub/kserve-controller-manager-service.opendatahub.svc.cluster.local: 100.219966ms since last change, 100.219903ms since last push, full=false 2026-09-09T23:33:15.390723Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:33:01Z/78 2026-09-09T23:33:21.729111Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:33:21.854676Z info ads Push debounce stable[127] 5 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs and 3 more configs: 100.081517ms since last change, 226.55215ms since last push, full=true 2026-09-09T23:33:21.855330Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:33:21Z/79 2026-09-09T23:33:21.855869Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:33:21.855875Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:33:21.856586Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:33:21.856684Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:33:21.856862Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:33:21.856985Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:33:21.857038Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:33:21.857183Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:33:21.858455Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:33:21.858498Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:33:21.860510Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-09T23:33:21.860631Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 filtered:134 2026-09-09T23:33:22.622080Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:33:22.722371Z info ads Push debounce stable[128] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.225475ms since last change, 100.225422ms since last push, full=true 2026-09-09T23:33:22.722947Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:33:22Z/80 2026-09-09T23:33:22.723534Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:33:22.723552Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:33:22.723623Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-09T23:33:22.723679Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-09T23:33:22.723922Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:33:22.724021Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:33:22.724250Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:33:22.726059Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:33:24.611058Z info ads Push debounce stable[129] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.218862ms since last change, 100.218802ms since last push, full=true 2026-09-09T23:33:24.624671Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:33:24Z/81 2026-09-09T23:33:24.625791Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:136 removed:0 size:157.6kB cached:134/135 2026-09-09T23:33:24.626629Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T23:33:24.626918Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:33:24.627016Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-68cf4d799c9l64l.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:33:24.629531Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-09T23:33:24.630217Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T23:33:24.630721Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-09T23:33:24.632723Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:33:30.484661Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5ccb968c66-knv7q.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:33:38.220448Z info ads Push debounce stable[130] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.326727ms since last change, 100.326608ms since last push, full=false 2026-09-09T23:33:38.220521Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:33:24Z/81 2026-09-09T23:34:02.216420Z info ads Push debounce stable[131] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.213027ms since last change, 100.212957ms since last push, full=false 2026-09-09T23:34:02.216482Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:33:24Z/81 2026-09-09T23:34:31.925490Z info ads Push debounce stable[132] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.217662ms since last change, 100.217608ms since last push, full=false 2026-09-09T23:34:31.925549Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:33:24Z/81 2026-09-09T23:34:34.723623Z info ads Push debounce stable[133] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.05939ms since last change, 100.059328ms since last push, full=false 2026-09-09T23:34:34.723681Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:33:24Z/81 2026-09-09T23:34:37.016556Z info ads Push debounce stable[134] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.210809ms since last change, 100.210741ms since last push, full=false 2026-09-09T23:34:37.016624Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:33:24Z/81 2026-09-09T23:34:39.022969Z info ads Push debounce stable[135] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.218298ms since last change, 100.218228ms since last push, full=false 2026-09-09T23:34:39.023024Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:33:24Z/81 2026-09-09T23:34:49.218930Z info ads Push debounce stable[136] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.216743ms since last change, 100.216678ms since last push, full=false 2026-09-09T23:34:49.218992Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:33:24Z/81