2026-09-09T23:16:48.882585Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:16:37Z/47 2026-09-09T23:17:09.128122Z info ads Push debounce stable[83] 7 for config ConfigMap/models-as-a-service/kube-root-ca.crt and 3 more configs: 100.872134ms since last change, 135.947273ms since last push, full=false 2026-09-09T23:17:09.128170Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:16:37Z/47 2026-09-09T23:17:10.458560Z info model Incremental push, service maas-api.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:17:10.473990Z info model Incremental push, service maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:17:10.661681Z info ads Push debounce stable[84] 8 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 3 more configs: 100.927425ms since last change, 209.41234ms since last push, full=true 2026-09-09T23:17:10.662250Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-09-09T23:17:10Z/48 2026-09-09T23:17:10.662765Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:4 removed:0 size:2.7kB cached:0/2 2026-09-09T23:17:10.662848Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:3 removed:0 size:2.3kB cached:0/2 2026-09-09T23:17:10.663056Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:10.663150Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:10.663059Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T23:17:10.663220Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T23:17:10.663252Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T23:17:10.663193Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:17:10.663282Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:17:10.669202Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 filtered:124 2026-09-09T23:17:10.670977Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 filtered:124 2026-09-09T23:17:10.833532Z info ads Push debounce stable[85] 2 for config Secret/odh-ai-gateway-infra/maas-api-serving-cert and 1 more configs: 100.596716ms since last change, 156.208691ms since last push, full=false 2026-09-09T23:17:10.833576Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:17:10Z/48 2026-09-09T23:17:11.020644Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:17:11.072744Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:17:11.237789Z info ads Push debounce stable[86] 11 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 7 more configs: 101.020574ms since last change, 357.39948ms since last push, full=true 2026-09-09T23:17:11.239122Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:17:11Z/49 2026-09-09T23:17:11.240437Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:129 removed:0 size:149.2kB cached:118/128 2026-09-09T23:17:11.240558Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:130 removed:0 size:149.5kB cached:118/128 2026-09-09T23:17:11.241162Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:126 removed:0 size:29.9kB empty:1 cached:125/126 2026-09-09T23:17:11.241407Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:126 removed:0 size:29.9kB empty:0 cached:126/126 2026-09-09T23:17:11.241409Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:11.241650Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:11.241690Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.3kB 2026-09-09T23:17:11.241697Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:17:11.241959Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:17:11.241991Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:17:11.254165Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:126 2026-09-09T23:17:11.254586Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:126 2026-09-09T23:17:11.432501Z info ads Push debounce stable[87] 3 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway and 2 more configs: 100.249086ms since last change, 170.473709ms since last push, full=true 2026-09-09T23:17:11.434256Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:17:11Z/50 2026-09-09T23:17:11.435325Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T23:17:11.435822Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:17:11.436231Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:11.436317Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:11.438370Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:132 removed:0 size:149.7kB cached:0/128 2026-09-09T23:17:11.438813Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:17:11.439035Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:17:11.439244Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:17:12.492334Z info ads Push debounce stable[88] 1 for config EnvoyFilter/openshift-ingress/payload-processing: 100.20826ms since last change, 100.208191ms since last push, full=true 2026-09-09T23:17:12.493345Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:17:12Z/51 2026-09-09T23:17:12.494110Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T23:17:12.494179Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:132 removed:0 size:149.7kB cached:128/128 2026-09-09T23:17:12.494818Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:17:12.495048Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:17:12.495083Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:17:12.495258Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:12.495341Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:12.495372Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:17:13.369043Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:17:13.697583Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T23:17:13.698378Z info model Full push, new service odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T23:17:13.798470Z info ads Push debounce stable[89] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.046301ms since last change, 100.838696ms since last push, full=true 2026-09-09T23:17:13.799019Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:17:13Z/52 2026-09-09T23:17:13.799731Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:3 removed:0 size:2.4kB cached:0/2 2026-09-09T23:17:13.799743Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:6 removed:0 size:3.0kB cached:0/2 2026-09-09T23:17:13.799816Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:136B empty:1 cached:1/2 2026-09-09T23:17:13.799823Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:2 removed:0 size:136B empty:1 cached:1/2 2026-09-09T23:17:13.800063Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:13.800170Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:13.800177Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:17:13.800432Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:17:14.706507Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-09T23:17:14.783305Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-09T23:17:14.884448Z info ads Push debounce stable[90] 2 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 1 more configs: 101.032283ms since last change, 177.814635ms since last push, full=true 2026-09-09T23:17:14.885058Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:17:14Z/53 2026-09-09T23:17:14.885612Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-09T23:17:14.885690Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 2026-09-09T23:17:14.885795Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:6 removed:0 size:2.8kB cached:0/2 2026-09-09T23:17:14.885884Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 2026-09-09T23:17:14.885988Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:14.886064Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:14.886099Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:17:14.886312Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:17:19.814285Z info ads Push debounce stable[91] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.150256ms since last change, 103.101399ms since last push, full=false 2026-09-09T23:17:19.814335Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:17:14Z/53 2026-09-09T23:17:20.776233Z info ads Push debounce stable[92] 8 for config Gateway/openshift-ingress/maas-default-gateway-istio-autogenerated-k8s-gateway-https and 4 more configs: 100.033982ms since last change, 146.36986ms since last push, full=true 2026-09-09T23:17:20.776350Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:17:20Z/54 2026-09-09T23:17:20.777269Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:129 removed:0 size:149.2kB cached:126/128 2026-09-09T23:17:20.777405Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-09T23:17:20.777852Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:128 removed:0 size:30.3kB empty:0 cached:128/128 2026-09-09T23:17:20.777991Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:128 removed:0 size:30.3kB empty:0 cached:128/128 2026-09-09T23:17:20.778117Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:20.778220Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:20.778232Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:17:20.778262Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:17:20.778468Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:17:20.778501Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:17:21.057693Z info delta ADS: "10.134.0.46:34284" maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress-2 terminated 2026-09-09T23:17:21.768708Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:17:21.768740Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:17:21.800915Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:17:21.856497Z info ads Push debounce stable[93] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.458492ms since last change, 100.458441ms since last push, full=false 2026-09-09T23:17:21.856541Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-09-09T23:17:20Z/54 2026-09-09T23:17:21.907526Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress-3 2026-09-09T23:17:21.908310Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-09T23:17:21.990170Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 filtered:0 2026-09-09T23:17:22.039821Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:17:22.050791Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-09T23:17:22.051274Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-09T23:17:23.369188Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|15021||maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local": {}, "outbound|443||maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local": {} } } 2026-09-09T23:17:25.891410Z info ads Push debounce stable[94] 2 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.545205ms since last change, 174.470391ms since last push, full=false 2026-09-09T23:17:25.891467Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:17:20Z/54 2026-09-09T23:17:28.238229Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-09T23:17:28.238892Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:128 removed:0 size:30.2kB empty:0 cached:128/128 2026-09-09T23:17:28.239162Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:17:28.239395Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:17:28.239428Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:17:28.254098Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:17:28.254128Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:17:28.283246Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:17:28.342253Z info ads Push debounce stable[95] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.663285ms since last change, 100.66317ms since last push, full=false 2026-09-09T23:17:28.342300Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:17:20Z/54 2026-09-09T23:17:43.945425Z info ads Push debounce stable[96] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 101.057359ms since last change, 101.057297ms since last push, full=false 2026-09-09T23:17:43.945473Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:17:20Z/54 2026-09-09T23:17:44.160952Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:17:44.277256Z info ads Push debounce stable[97] 3 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.814726ms since last change, 123.341245ms since last push, full=true 2026-09-09T23:17:44.277794Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:17:44Z/55 2026-09-09T23:17:44.278334Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T23:17:44.278349Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T23:17:44.278651Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:17:44.278684Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:44.278782Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:44.279264Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:17:44.285968Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-09T23:17:44.286147Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-09T23:17:44.543526Z info ads Push debounce stable[98] 1 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc: 100.831623ms since last change, 100.831562ms since last push, full=true 2026-09-09T23:17:44.543694Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:17:44Z/56 2026-09-09T23:17:44.545179Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:17:44.546213Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:129 removed:0 size:30.7kB empty:1 cached:128/129 2026-09-09T23:17:44.546568Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:44.546721Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:44.547998Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:17:44.549339Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:17:44.549560Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:17:44.549893Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:17:44.836530Z info ads Push debounce stable[99] 3 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway and 1 more configs: 100.231368ms since last change, 188.649349ms since last push, full=true 2026-09-09T23:17:44.840404Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:17:44Z/57 2026-09-09T23:17:44.841870Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:130 removed:0 size:150.4kB cached:125/129 2026-09-09T23:17:44.843179Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:17:44.843465Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:44.843622Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:44.843667Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:17:44.845703Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:133 removed:0 size:151.0kB cached:0/129 2026-09-09T23:17:44.846133Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:17:44.846405Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:17:44.846743Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:17:44.846775Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:17:45.928196Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:17:46.028478Z info ads Push debounce stable[100] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.227802ms since last change, 100.227727ms since last push, full=true 2026-09-09T23:17:46.029069Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:17:46Z/58 2026-09-09T23:17:46.029649Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:17:46.029680Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:17:46.029726Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-09-09T23:17:46.029741Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-09-09T23:17:46.030062Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:46.030172Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:46.030257Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:17:46.030691Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:17:53.368508Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:17:57.752864Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:17:58.043529Z info ads Push debounce stable[101] 5 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs and 3 more configs: 101.00608ms since last change, 394.126952ms since last push, full=true 2026-09-09T23:17:58.044137Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:17:58Z/59 2026-09-09T23:17:58.044794Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:17:58.044817Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:17:58.045528Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:17:58.045604Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:17:58.045945Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:17:58.045948Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:58.046186Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:58.046223Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:17:58.046461Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:17:58.046496Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:17:58.050377Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-09T23:17:58.051703Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-09T23:17:58.538201Z info ads Push debounce stable[102] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.794284ms since last change, 100.794202ms since last push, full=true 2026-09-09T23:17:58.543141Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:17:58Z/60 2026-09-09T23:17:58.544121Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:131 removed:0 size:151.5kB cached:130/130 2026-09-09T23:17:58.544601Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:17:58.544907Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:17:58.545002Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:17:58.547065Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-09T23:17:58.547582Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:17:58.547980Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:17:58.548516Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:17:59.987812Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:18:00.088213Z info ads Push debounce stable[103] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.300264ms since last change, 100.300213ms since last push, full=true 2026-09-09T23:18:00.088773Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:18:00Z/61 2026-09-09T23:18:00.089329Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:18:00.089402Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-09T23:18:00.089332Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:18:00.089513Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-09T23:18:00.089620Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:00.089716Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:00.089934Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:18:00.090369Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:18:03.369131Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:18:08.949178Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:18:09.141722Z info ads Push debounce stable[104] 5 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs and 3 more configs: 101.011154ms since last change, 289.322651ms since last push, full=true 2026-09-09T23:18:09.142371Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:18:09Z/62 2026-09-09T23:18:09.142928Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:18:09.142956Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:18:09.143518Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:18:09.143767Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:18:09.143881Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:09.143983Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:09.144025Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:18:09.144203Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:18:09.144768Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:18:09.144799Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:18:09.147512Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-09T23:18:09.147545Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-09T23:18:10.150121Z info ads Push debounce stable[105] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.173745ms since last change, 100.173678ms since last push, full=true 2026-09-09T23:18:10.157800Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:18:10Z/63 2026-09-09T23:18:10.159305Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:132 removed:0 size:152.7kB cached:131/131 2026-09-09T23:18:10.160508Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:18:10.160807Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:10.160933Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:10.163019Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-09T23:18:10.163678Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:18:10.164034Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:18:10.164741Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:18:10.819145Z info model Incremental push, service kserve-controller-manager-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:18:10.821952Z info model Incremental push, service kserve-controller-manager-metrics-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:18:10.923101Z info ads Push debounce stable[106] 2 for config ServiceEntry/opendatahub/kserve-controller-manager-service.opendatahub.svc.cluster.local and 1 more configs: 101.051414ms since last change, 103.904165ms since last push, full=false 2026-09-09T23:18:10.923176Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:10Z/63 2026-09-09T23:18:11.145717Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:18:11.245959Z info ads Push debounce stable[107] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.199248ms since last change, 100.199194ms since last push, full=true 2026-09-09T23:18:11.246477Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:18:11Z/64 2026-09-09T23:18:11.247100Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:18:11.247194Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T23:18:11.247247Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:18:11.247310Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-09T23:18:11.247447Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:11.247535Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:11.247772Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:18:11.248443Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:18:13.369150Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:18:19.992547Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:18:20.157438Z info ads Push debounce stable[108] 5 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs and 3 more configs: 100.71191ms since last change, 211.07112ms since last push, full=true 2026-09-09T23:18:20.158102Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:18:20Z/65 2026-09-09T23:18:20.158649Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:18:20.158654Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:18:20.159265Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:18:20.159423Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:18:20.159485Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:20.159579Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:20.159614Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:18:20.159721Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:18:20.160638Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:18:20.160679Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:18:20.163754Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-09T23:18:20.164050Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-09T23:18:20.288909Z info ads Push debounce stable[109] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.51005ms since last change, 100.509988ms since last push, full=false 2026-09-09T23:18:20.288959Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:20Z/65 2026-09-09T23:18:21.097131Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:18:21.197404Z info ads Push debounce stable[110] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.215688ms since last change, 100.215634ms since last push, full=true 2026-09-09T23:18:21.197969Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:18:21Z/66 2026-09-09T23:18:21.198588Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:18:21.198661Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T23:18:21.198694Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:18:21.198764Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-09T23:18:21.198918Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:21.199021Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:21.199258Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:18:21.200206Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:18:21.352194Z info ads Push debounce stable[111] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.085901ms since last change, 100.085835ms since last push, full=true 2026-09-09T23:18:21.360287Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:18:21Z/67 2026-09-09T23:18:21.361299Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:133 removed:0 size:153.9kB cached:129/132 2026-09-09T23:18:21.361821Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T23:18:21.362045Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:21.362118Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:21.364017Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-09T23:18:21.364435Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T23:18:21.364746Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:18:21.365435Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:18:23.369207Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:18:24.146729Z info ads Push debounce stable[112] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.910681ms since last change, 100.9106ms since last push, full=false 2026-09-09T23:18:24.146778Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:21Z/67 2026-09-09T23:18:24.161697Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:18:24.340905Z info ads Push debounce stable[113] 4 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local and 2 more configs: 100.941114ms since last change, 185.232834ms since last push, full=true 2026-09-09T23:18:24.341509Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:18:24Z/68 2026-09-09T23:18:24.342011Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:18:24.342018Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:18:24.342630Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T23:18:24.342679Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T23:18:24.342943Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:24.343067Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:24.343085Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:18:24.344171Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:18:24.346592Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-09T23:18:24.347443Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-09T23:18:25.199924Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:18:25.300273Z info ads Push debounce stable[114] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.299623ms since last change, 100.29957ms since last push, full=true 2026-09-09T23:18:25.300816Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:18:25Z/69 2026-09-09T23:18:25.301450Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:18:25.301495Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:18:25.301545Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-09-09T23:18:25.301552Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 2026-09-09T23:18:25.301773Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:25.301886Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:25.302145Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:18:25.302996Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:18:26.251214Z info ads Push debounce stable[115] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.220824ms since last change, 100.220703ms since last push, full=true 2026-09-09T23:18:26.260965Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:18:26Z/70 2026-09-09T23:18:26.261900Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:134 removed:0 size:155.2kB cached:133/133 2026-09-09T23:18:26.262531Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T23:18:26.262909Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:26.263028Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:26.264948Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-09T23:18:26.265391Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T23:18:26.265703Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:18:26.266540Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:18:31.254269Z info ads Push debounce stable[116] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.166472ms since last change, 100.166408ms since last push, full=false 2026-09-09T23:18:31.254325Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:26Z/70 2026-09-09T23:18:33.368393Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:18:33.378156Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:18:33.494083Z info ads Push debounce stable[117] 4 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs and 2 more configs: 101.01822ms since last change, 142.845634ms since last push, full=true 2026-09-09T23:18:33.494651Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:18:33Z/71 2026-09-09T23:18:33.495250Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T23:18:33.495284Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T23:18:33.495524Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:33.495601Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:33.495630Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:18:33.495885Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:18:33.496866Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:18:33.496910Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:18:33.501059Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-09T23:18:33.502368Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-09T23:18:33.642748Z info ads Push debounce stable[118] 1 for config DestinationRule/llm/facebook-opt-125m-simulated-kserve-workload-svc: 100.208547ms since last change, 100.208481ms since last push, full=true 2026-09-09T23:18:33.642910Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:18:33Z/72 2026-09-09T23:18:33.643401Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:18:33.643453Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:18:33.644022Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:134 removed:0 size:31.4kB empty:1 cached:133/134 2026-09-09T23:18:33.644082Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:134 removed:0 size:31.4kB empty:0 cached:134/134 2026-09-09T23:18:33.644354Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:33.644423Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:18:33.644450Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:33.645497Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:18:34.242734Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:18:34.343098Z info ads Push debounce stable[119] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.218511ms since last change, 100.218439ms since last push, full=true 2026-09-09T23:18:34.343686Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:18:34Z/73 2026-09-09T23:18:34.344316Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:18:34.344360Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:18:34.344409Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-09T23:18:34.344419Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 2026-09-09T23:18:34.344724Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:34.344901Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:34.345040Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:18:34.346093Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:18:35.371891Z info ads Push debounce stable[120] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.328306ms since last change, 100.328233ms since last push, full=false 2026-09-09T23:18:35.371971Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:34Z/73 2026-09-09T23:18:35.759961Z info ads Push debounce stable[121] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.210801ms since last change, 100.210718ms since last push, full=true 2026-09-09T23:18:35.771688Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:18:35Z/74 2026-09-09T23:18:35.772765Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:135 removed:0 size:156.3kB cached:132/134 2026-09-09T23:18:35.773422Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:18:35.773710Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:35.773789Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:35.775541Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-09T23:18:35.776081Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:18:35.776903Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:18:35.777923Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:18:41.369236Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:18:41.556556Z info ads Push debounce stable[122] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.594402ms since last change, 210.13347ms since last push, full=true 2026-09-09T23:18:41.557176Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:18:41Z/75 2026-09-09T23:18:41.557728Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:18:41.557855Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:18:41.558313Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:18:41.558439Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:18:41.558628Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:18:41.558674Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:41.558782Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:41.558842Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:18:41.560744Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:18:41.560878Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:18:41.564901Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-09T23:18:41.564936Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 filtered:134 2026-09-09T23:18:43.203921Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:18:43.304293Z info ads Push debounce stable[123] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.316272ms since last change, 100.316192ms since last push, full=true 2026-09-09T23:18:43.304885Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:18:43Z/76 2026-09-09T23:18:43.305474Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:18:43.305562Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-09T23:18:43.305568Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:18:43.305637Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-09-09T23:18:43.305874Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:43.305986Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:43.306152Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:18:43.307422Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:18:43.368708Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:18:44.169665Z info ads Push debounce stable[124] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.761633ms since last change, 100.761581ms since last push, full=true 2026-09-09T23:18:44.182911Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:18:44Z/77 2026-09-09T23:18:44.183765Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:136 removed:0 size:157.6kB cached:135/135 2026-09-09T23:18:44.184571Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T23:18:44.184849Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:18:44.184981Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:18:44.186994Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-09T23:18:44.187440Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T23:18:44.187781Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-09T23:18:44.188841Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:18:46.148342Z info ads Push debounce stable[125] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 101.012642ms since last change, 101.012571ms since last push, full=false 2026-09-09T23:18:46.148404Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:44Z/77 2026-09-09T23:18:52.448102Z info ads Push debounce stable[126] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.20703ms since last change, 100.206974ms since last push, full=false 2026-09-09T23:18:52.448159Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:44Z/77 2026-09-09T23:18:53.368861Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-2r2l5.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:19:04.058212Z info ads Push debounce stable[127] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.209935ms since last change, 100.209871ms since last push, full=false 2026-09-09T23:19:04.058262Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:44Z/77 2026-09-09T23:19:16.250904Z info ads Push debounce stable[128] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.200272ms since last change, 100.200186ms since last push, full=false 2026-09-09T23:19:16.250957Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:44Z/77 2026-09-09T23:19:25.756227Z info ads Push debounce stable[129] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.202705ms since last change, 100.202644ms since last push, full=false 2026-09-09T23:19:25.756284Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:44Z/77 2026-09-09T23:19:37.849010Z info ads Push debounce stable[130] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.204011ms since last change, 100.203949ms since last push, full=false 2026-09-09T23:19:37.849081Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:44Z/77 2026-09-09T23:19:48.853616Z info ads Push debounce stable[131] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.210629ms since last change, 100.210565ms since last push, full=false 2026-09-09T23:19:48.853672Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:18:44Z/77