2026-09-10T04:50:03.841355Z info ads Push debounce stable[90] 2 for config ServiceEntry/opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local and 1 more configs: 100.191424ms since last change, 103.059046ms since last push, full=true 2026-09-10T04:50:03.841892Z info ads XDS: Pushing Services:96 ConnectedEndpoints:2 Version:2026-09-10T04:50:03Z/52 2026-09-10T04:50:03.842407Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:4 removed:0 size:2.5kB cached:0/2 2026-09-10T04:50:03.842452Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-10T04:50:03.842481Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 2026-09-10T04:50:03.842512Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:147B empty:0 cached:2/2 2026-09-10T04:50:03.842695Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:03.842699Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-10T04:50:03.842815Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:03.842843Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-10T04:50:03.842877Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-10T04:50:06.750584Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {}, "outbound|8443||maas-controller-metrics.opendatahub.svc.cluster.local": {} } } 2026-09-10T04:50:14.844829Z info ads Push debounce stable[91] 2 for config ServiceEntry/opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local and 1 more configs: 100.678499ms since last change, 103.873643ms since last push, full=false 2026-09-10T04:50:14.844888Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:50:03Z/52 2026-09-10T04:50:15.050984Z info ads Push debounce stable[92] 4 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.897689ms since last change, 126.137031ms since last push, full=false 2026-09-10T04:50:15.051037Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:50:03Z/52 2026-09-10T04:50:15.304240Z info ads Push debounce stable[93] 2 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.061396ms since last change, 100.607312ms since last push, full=false 2026-09-10T04:50:15.304287Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:50:03Z/52 2026-09-10T04:50:35.115014Z info ads Push debounce stable[94] 7 for config ConfigMap/models-as-a-service/kube-root-ca.crt and 3 more configs: 100.767183ms since last change, 137.676751ms since last push, full=false 2026-09-10T04:50:35.115062Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:50:03Z/52 2026-09-10T04:50:36.498077Z info model Incremental push, service maas-api.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:50:36.519857Z info model Incremental push, service maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:50:36.848824Z info ads Push debounce stable[95] 10 for config Secret/odh-ai-gateway-infra/maas-api-serving-cert and 5 more configs: 100.9431ms since last change, 355.323466ms since last push, full=true 2026-09-10T04:50:36.849340Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-09-10T04:50:36Z/53 2026-09-10T04:50:36.849953Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:3 removed:0 size:2.3kB cached:0/2 2026-09-10T04:50:36.849967Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:4 removed:0 size:2.7kB cached:0/2 2026-09-10T04:50:36.850257Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:36.850303Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-10T04:50:36.850331Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-10T04:50:36.850357Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-10T04:50:36.850366Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:36.850391Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T04:50:36.850406Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T04:50:36.856284Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 filtered:124 2026-09-10T04:50:36.856364Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 filtered:124 2026-09-10T04:50:37.113512Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:50:37.168617Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:50:37.447475Z info ads Push debounce stable[96] 14 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 10 more configs: 100.677153ms since last change, 470.73201ms since last push, full=true 2026-09-10T04:50:37.450480Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T04:50:37Z/54 2026-09-10T04:50:37.451953Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:129 removed:0 size:149.2kB cached:118/128 2026-09-10T04:50:37.452508Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:126 removed:0 size:29.9kB empty:1 cached:125/126 2026-09-10T04:50:37.452807Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:37.452919Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:37.452959Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T04:50:37.454680Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:132 removed:0 size:149.7kB cached:0/128 2026-09-10T04:50:37.455247Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:126 removed:0 size:29.9kB empty:0 cached:126/126 2026-09-10T04:50:37.455493Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T04:50:37.455747Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T04:50:37.455784Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T04:50:37.467304Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:126 2026-09-10T04:50:37.472414Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:126 2026-09-10T04:50:37.887251Z info ads Push debounce stable[97] 1 for config EnvoyFilter/openshift-ingress/payload-processing: 100.402572ms since last change, 100.402528ms since last push, full=true 2026-09-10T04:50:37.888225Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T04:50:37Z/55 2026-09-10T04:50:37.888960Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-10T04:50:37.889358Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:132 removed:0 size:149.7kB cached:128/128 2026-09-10T04:50:37.889752Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-10T04:50:37.889856Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-10T04:50:37.890079Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:37.890169Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T04:50:37.890240Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:37.890466Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T04:50:39.140116Z info model Full push, new service odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local 2026-09-10T04:50:39.144118Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-10T04:50:39.244850Z info ads Push debounce stable[98] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.685284ms since last change, 104.678284ms since last push, full=true 2026-09-10T04:50:39.245539Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T04:50:39Z/56 2026-09-10T04:50:39.246939Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:3 removed:0 size:2.4kB cached:0/2 2026-09-10T04:50:39.247051Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 2026-09-10T04:50:39.247121Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:6 removed:0 size:3.0kB cached:0/2 2026-09-10T04:50:39.247196Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 2026-09-10T04:50:39.247326Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:39.247430Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:39.247961Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T04:50:39.248269Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T04:50:39.901282Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-10T04:50:40.001979Z info ads Push debounce stable[99] 1 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local: 100.582444ms since last change, 100.582385ms since last push, full=true 2026-09-10T04:50:40.002495Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T04:50:40Z/57 2026-09-10T04:50:40.003211Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-09-10T04:50:40.003270Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.7kB cached:0/1 2026-09-10T04:50:40.003292Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:75B empty:1 cached:0/1 2026-09-10T04:50:40.003345Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:75B empty:0 cached:1/1 2026-09-10T04:50:40.003555Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T04:50:40.003565Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:40.003646Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:40.003791Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T04:50:40.154013Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-10T04:50:40.254856Z info ads Push debounce stable[100] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.792221ms since last change, 100.792159ms since last push, full=true 2026-09-10T04:50:40.255552Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-10T04:50:40Z/58 2026-09-10T04:50:40.256586Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.7kB cached:0/1 2026-09-10T04:50:40.256679Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:71B empty:1 cached:0/1 2026-09-10T04:50:40.256898Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-09-10T04:50:40.256965Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:71B empty:0 cached:1/1 2026-09-10T04:50:40.257009Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T04:50:40.257195Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:40.257288Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:40.257326Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-10T04:50:45.258557Z info ads Push debounce stable[101] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.192628ms since last change, 100.625282ms since last push, full=false 2026-09-10T04:50:45.258630Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:50:40Z/58 2026-09-10T04:50:46.357570Z info delta ADS: "10.134.0.19:50650" maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress-2 terminated 2026-09-10T04:50:46.751223Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|9004||payload-processing.openshift-ingress.svc.cluster.local": {} } } 2026-09-10T04:50:46.782333Z info ads Push debounce stable[102] 8 for config Gateway/openshift-ingress/maas-default-gateway-istio-autogenerated-k8s-gateway-https and 4 more configs: 101.007734ms since last change, 147.002956ms since last push, full=true 2026-09-10T04:50:46.782473Z info ads XDS: Pushing Services:100 ConnectedEndpoints:1 Version:2026-09-10T04:50:46Z/59 2026-09-10T04:50:46.783381Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:129 removed:0 size:149.2kB cached:126/128 2026-09-10T04:50:46.784160Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:128 removed:0 size:30.3kB empty:0 cached:128/128 2026-09-10T04:50:46.784446Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:46.784545Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:46.784647Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T04:50:47.199362Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-10T04:50:47.199404Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-10T04:50:47.256243Z info ads Push debounce stable[103] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 101.077162ms since last change, 101.077074ms since last push, full=false 2026-09-10T04:50:47.256296Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-09-10T04:50:46Z/59 2026-09-10T04:50:47.258873Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-10T04:50:47.267896Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress-3 2026-09-10T04:50:47.268988Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-10T04:50:47.345300Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 filtered:0 2026-09-10T04:50:47.625035Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T04:50:47.632396Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-10T04:50:47.632493Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-10T04:50:51.044862Z info ads Push debounce stable[104] 2 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs and 1 more configs: 100.755156ms since last change, 137.315503ms since last push, full=false 2026-09-10T04:50:51.045010Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:50:46Z/59 2026-09-10T04:50:51.171385Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:50:51.352852Z info ads Push debounce stable[105] 4 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 2 more configs: 103.967127ms since last change, 193.6576ms since last push, full=true 2026-09-10T04:50:51.353640Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T04:50:51Z/60 2026-09-10T04:50:51.354659Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:6 removed:0 size:3.0kB cached:0/2 2026-09-10T04:50:51.354852Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:219B empty:0 cached:0/1 2026-09-10T04:50:51.355119Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:3 removed:0 size:2.5kB cached:0/2 2026-09-10T04:50:51.355199Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T04:50:51.355247Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:219B empty:0 cached:1/1 2026-09-10T04:50:51.355502Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:51.355612Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:51.355931Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T04:50:51.364122Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-10T04:50:51.845849Z info ads Push debounce stable[106] 1 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc: 100.497878ms since last change, 100.497789ms since last push, full=true 2026-09-10T04:50:51.846094Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T04:50:51Z/61 2026-09-10T04:50:51.846863Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T04:50:51.847654Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:128 removed:0 size:30.2kB empty:0 cached:128/128 2026-09-10T04:50:51.848034Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-10T04:50:51.848906Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T04:50:51.849275Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T04:50:51.850037Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:129 removed:0 size:30.3kB empty:1 cached:128/129 2026-09-10T04:50:51.850286Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:51.850406Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:51.966957Z info ads Push debounce stable[107] 3 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-2fslq and 1 more configs: 101.018272ms since last change, 115.252052ms since last push, full=true 2026-09-10T04:50:51.970262Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T04:50:51Z/62 2026-09-10T04:50:51.971345Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:130 removed:0 size:150.4kB cached:126/129 2026-09-10T04:50:51.971833Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:129 removed:0 size:30.3kB empty:0 cached:129/129 2026-09-10T04:50:51.972110Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:51.972212Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:51.972248Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T04:50:51.975399Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:133 removed:0 size:151.0kB cached:0/129 2026-09-10T04:50:51.976070Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:128 removed:0 size:30.2kB empty:0 cached:128/128 2026-09-10T04:50:51.976426Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-10T04:50:51.976945Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T04:50:51.976990Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T04:50:53.307644Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-10T04:50:54.154920Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T04:50:54.219041Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:133 removed:0 size:151.0kB cached:128/129 2026-09-10T04:50:54.219721Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:129 removed:0 size:30.3kB empty:1 cached:128/129 2026-09-10T04:50:54.220083Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-10T04:50:54.220621Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T04:50:54.220672Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T04:50:54.237180Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-10T04:50:54.237211Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-10T04:50:54.270999Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-10T04:50:54.324908Z info ads Push debounce stable[108] 2 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.268398ms since last change, 169.876201ms since last push, full=true 2026-09-10T04:50:54.325467Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-10T04:50:54Z/63 2026-09-10T04:50:54.326196Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:4 removed:0 size:3.9kB cached:0/3 2026-09-10T04:50:54.326331Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:7 removed:0 size:4.5kB cached:0/3 2026-09-10T04:50:54.326344Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:3 removed:0 size:667B empty:1 cached:0/3 2026-09-10T04:50:54.326468Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:3 removed:0 size:667B empty:0 cached:3/3 2026-09-10T04:50:54.326759Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:50:54.326895Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:50:54.327011Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-10T04:50:54.327399Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-10T04:50:56.750613Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-10T04:51:09.849359Z info ads Push debounce stable[109] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.894091ms since last change, 100.894011ms since last push, full=false 2026-09-10T04:51:09.849407Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:50:54Z/63 2026-09-10T04:51:09.872953Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:51:10.044221Z info ads Push debounce stable[110] 4 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local and 2 more configs: 100.333162ms since last change, 178.46902ms since last push, full=true 2026-09-10T04:51:10.044821Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-10T04:51:10Z/64 2026-09-10T04:51:10.045319Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T04:51:10.045323Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T04:51:10.045991Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-10T04:51:10.045996Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-10T04:51:10.046433Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-10T04:51:10.046451Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:10.046551Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:10.047028Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-10T04:51:10.049868Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-10T04:51:10.049895Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-10T04:51:11.064095Z info ads Push debounce stable[111] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.220104ms since last change, 100.220052ms since last push, full=true 2026-09-10T04:51:11.069083Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-10T04:51:11Z/65 2026-09-10T04:51:11.069961Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:131 removed:0 size:151.5kB cached:130/130 2026-09-10T04:51:11.070551Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-10T04:51:11.070787Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:11.070896Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:11.073061Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-10T04:51:11.073754Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-10T04:51:11.074225Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T04:51:11.074907Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-10T04:51:12.362373Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T04:51:12.462660Z info ads Push debounce stable[112] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.229298ms since last change, 100.229247ms since last push, full=true 2026-09-10T04:51:12.463191Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-10T04:51:12Z/66 2026-09-10T04:51:12.463820Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T04:51:12.463906Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-10T04:51:12.463910Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T04:51:12.463974Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-10T04:51:12.464150Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:12.464244Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:12.464410Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T04:51:12.465051Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-10T04:51:16.750730Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-10T04:51:25.186825Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:51:25.361330Z info ads Push debounce stable[113] 5 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs and 3 more configs: 100.55153ms since last change, 215.161248ms since last push, full=true 2026-09-10T04:51:25.361923Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-10T04:51:25Z/67 2026-09-10T04:51:25.362429Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T04:51:25.362432Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T04:51:25.363179Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-10T04:51:25.363464Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:25.363479Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-10T04:51:25.363570Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:25.363614Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T04:51:25.363997Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T04:51:25.372131Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-10T04:51:25.372341Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-10T04:51:25.372347Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T04:51:25.372682Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-10T04:51:26.302854Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T04:51:26.403150Z info ads Push debounce stable[114] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.234774ms since last change, 100.23471ms since last push, full=true 2026-09-10T04:51:26.403707Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-10T04:51:26Z/68 2026-09-10T04:51:26.404221Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T04:51:26.404290Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-10T04:51:26.404427Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T04:51:26.404494Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-10T04:51:26.404509Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:26.404602Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:26.404963Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-10T04:51:26.405906Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-10T04:51:26.669704Z info ads Push debounce stable[115] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.21408ms since last change, 100.214008ms since last push, full=true 2026-09-10T04:51:26.676204Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-10T04:51:26Z/69 2026-09-10T04:51:26.677169Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:132 removed:0 size:152.7kB cached:131/131 2026-09-10T04:51:26.677752Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T04:51:26.678065Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:26.678143Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:26.680185Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-10T04:51:26.680724Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-10T04:51:26.681078Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-10T04:51:26.681715Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-10T04:51:26.751013Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T04:51:36.450870Z info ads Push debounce stable[116] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.540404ms since last change, 100.540353ms since last push, full=false 2026-09-10T04:51:36.450920Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:51:26Z/69 2026-09-10T04:51:51.775960Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:51:51.895038Z info ads Push debounce stable[117] 4 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs and 2 more configs: 100.50185ms since last change, 144.638703ms since last push, full=true 2026-09-10T04:51:51.895588Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-10T04:51:51Z/70 2026-09-10T04:51:51.896166Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-10T04:51:51.896229Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-10T04:51:51.896484Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:51.896640Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:51.896711Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-10T04:51:51.896718Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T04:51:51.897829Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-10T04:51:51.897878Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T04:51:51.901631Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-10T04:51:51.901753Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-10T04:51:52.039216Z info ads Push debounce stable[118] 1 for config DestinationRule/llm/e2e-trlp-test-simulated-kserve-workload-svc: 100.226549ms since last change, 100.226486ms since last push, full=true 2026-09-10T04:51:52.039386Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-10T04:51:52Z/71 2026-09-10T04:51:52.039973Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T04:51:52.039989Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T04:51:52.040730Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:132 removed:0 size:31.1kB empty:1 cached:131/132 2026-09-10T04:51:52.040765Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-10T04:51:52.041019Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:52.041200Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:52.041253Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-10T04:51:52.042186Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-10T04:51:53.574295Z info ads Push debounce stable[119] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.213214ms since last change, 100.213099ms since last push, full=true 2026-09-10T04:51:53.582457Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-10T04:51:53Z/72 2026-09-10T04:51:53.583904Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:133 removed:0 size:153.9kB cached:131/132 2026-09-10T04:51:53.584576Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-10T04:51:53.584887Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:53.585003Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:53.587402Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-10T04:51:53.587957Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-10T04:51:53.588363Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T04:51:53.589296Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-10T04:51:54.225133Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T04:51:54.325497Z info ads Push debounce stable[120] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.220697ms since last change, 100.220625ms since last push, full=true 2026-09-10T04:51:54.326100Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-10T04:51:54Z/73 2026-09-10T04:51:54.326644Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T04:51:54.326664Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T04:51:54.326710Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-10T04:51:54.326720Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-10T04:51:54.327028Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:54.327118Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:54.327211Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T04:51:54.328168Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-10T04:51:56.751314Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-10T04:51:58.773356Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:51:58.942577Z info ads Push debounce stable[121] 5 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs and 3 more configs: 101.048351ms since last change, 194.14239ms since last push, full=true 2026-09-10T04:51:58.943214Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-10T04:51:58Z/74 2026-09-10T04:51:58.943723Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T04:51:58.943727Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T04:51:58.944482Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-10T04:51:58.944662Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-10T04:51:58.944940Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:51:58.945029Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T04:51:58.945101Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:51:58.945187Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T04:51:58.946128Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-10T04:51:58.946166Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T04:51:58.948153Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-10T04:51:58.948892Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-10T04:52:00.442697Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T04:52:00.542932Z info ads Push debounce stable[122] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.190436ms since last change, 100.190383ms since last push, full=true 2026-09-10T04:52:00.543518Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-10T04:52:00Z/75 2026-09-10T04:52:00.544085Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T04:52:00.544127Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T04:52:00.544167Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-09-10T04:52:00.544177Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 2026-09-10T04:52:00.544499Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:52:00.544597Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:52:00.544631Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-10T04:52:00.546124Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-10T04:52:01.086576Z info ads Push debounce stable[123] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.209988ms since last change, 100.209928ms since last push, full=true 2026-09-10T04:52:01.096633Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-10T04:52:01Z/76 2026-09-10T04:52:01.097495Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:134 removed:0 size:155.2kB cached:133/133 2026-09-10T04:52:01.098276Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-10T04:52:01.098583Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:52:01.098691Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:52:01.100540Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-10T04:52:01.101068Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-10T04:52:01.101554Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-10T04:52:01.102493Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-10T04:52:02.372188Z info ads Push debounce stable[124] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 101.072341ms since last change, 101.072289ms since last push, full=false 2026-09-10T04:52:02.372252Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:52:01Z/76 2026-09-10T04:52:06.751293Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T04:52:09.595161Z info ads Push debounce stable[125] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.467652ms since last change, 100.467584ms since last push, full=false 2026-09-10T04:52:09.595227Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:52:01Z/76 2026-09-10T04:52:19.543349Z info model Incremental push, service kserve-controller-manager-metrics-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:52:19.643639Z info ads Push debounce stable[126] 1 for config ServiceEntry/opendatahub/kserve-controller-manager-metrics-service.opendatahub.svc.cluster.local: 100.218139ms since last change, 100.218066ms since last push, full=false 2026-09-10T04:52:19.643695Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:52:01Z/76 2026-09-10T04:52:21.071398Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:52:21.254245Z info ads Push debounce stable[127] 5 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local and 3 more configs: 100.652726ms since last change, 208.155816ms since last push, full=true 2026-09-10T04:52:21.254929Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-10T04:52:21Z/77 2026-09-10T04:52:21.255497Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T04:52:21.255569Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T04:52:21.256150Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-10T04:52:21.256221Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-10T04:52:21.256463Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:52:21.256677Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-10T04:52:21.256681Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:52:21.256739Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T04:52:21.257847Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-10T04:52:21.257883Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T04:52:21.260065Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-10T04:52:21.260069Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-10T04:52:22.349346Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T04:52:22.449633Z info ads Push debounce stable[128] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.214396ms since last change, 100.214352ms since last push, full=true 2026-09-10T04:52:22.450246Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-10T04:52:22Z/78 2026-09-10T04:52:22.450834Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-10T04:52:22.450908Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-10T04:52:22.450837Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-10T04:52:22.451011Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 2026-09-10T04:52:22.451195Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:52:22.451299Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:52:22.451476Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-10T04:52:22.452626Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-10T04:52:23.685648Z info ads Push debounce stable[129] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.210298ms since last change, 100.210246ms since last push, full=true 2026-09-10T04:52:23.697135Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-10T04:52:23Z/79 2026-09-10T04:52:23.698433Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:135 removed:0 size:156.3kB cached:131/134 2026-09-10T04:52:23.699109Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T04:52:23.699397Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:52:23.699499Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:52:23.702071Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-10T04:52:23.702683Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T04:52:23.703125Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-10T04:52:23.704330Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-10T04:52:26.751312Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T04:52:33.188383Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-10T04:52:33.359526Z info ads Push debounce stable[130] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.897773ms since last change, 203.496321ms since last push, full=true 2026-09-10T04:52:33.360166Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-10T04:52:33Z/80 2026-09-10T04:52:33.360682Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T04:52:33.360770Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T04:52:33.361344Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T04:52:33.361458Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-10T04:52:33.361706Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:52:33.361777Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-10T04:52:33.361826Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:52:33.362063Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-10T04:52:33.363128Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-10T04:52:33.363161Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-10T04:52:33.365255Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-10T04:52:33.365326Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 filtered:134 2026-09-10T04:52:34.409623Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-10T04:52:34.509927Z info ads Push debounce stable[131] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.222199ms since last change, 100.221842ms since last push, full=true 2026-09-10T04:52:34.510532Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-10T04:52:34Z/81 2026-09-10T04:52:34.511151Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-10T04:52:34.511266Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-10T04:52:34.511327Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-10T04:52:34.511386Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-09-10T04:52:34.511552Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:52:34.511689Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:52:34.511943Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-10T04:52:34.513471Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-10T04:52:36.589023Z info ads Push debounce stable[132] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.230078ms since last change, 100.230028ms since last push, full=true 2026-09-10T04:52:36.602866Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-10T04:52:36Z/82 2026-09-10T04:52:36.603922Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:136 removed:0 size:157.6kB cached:135/135 2026-09-10T04:52:36.604458Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-10T04:52:36.604674Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-10T04:52:36.604761Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-ll5kd.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-10T04:52:36.607441Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-10T04:52:36.608112Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-10T04:52:36.608641Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-10T04:52:36.609887Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-10T04:52:36.750893Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rmn4t.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-10T04:52:53.553706Z info ads Push debounce stable[133] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.220586ms since last change, 100.220514ms since last push, full=false 2026-09-10T04:52:53.553756Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:52:36Z/82 2026-09-10T04:53:02.449835Z info ads Push debounce stable[134] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.217939ms since last change, 100.217878ms since last push, full=false 2026-09-10T04:53:02.449906Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:52:36Z/82 2026-09-10T04:53:05.453657Z info ads Push debounce stable[135] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.375689ms since last change, 100.37564ms since last push, full=false 2026-09-10T04:53:05.453700Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:52:36Z/82 2026-09-10T04:53:10.152347Z info ads Push debounce stable[136] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.222616ms since last change, 100.222558ms since last push, full=false 2026-09-10T04:53:10.152404Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:52:36Z/82 2026-09-10T04:53:22.155690Z info ads Push debounce stable[137] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.201581ms since last change, 100.201504ms since last push, full=false 2026-09-10T04:53:22.155749Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:52:36Z/82 2026-09-10T04:53:31.749637Z info ads Push debounce stable[138] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.402526ms since last change, 100.402465ms since last push, full=false 2026-09-10T04:53:31.749709Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:52:36Z/82 2026-09-10T04:53:36.149660Z info ads Push debounce stable[139] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.209212ms since last change, 100.20915ms since last push, full=false 2026-09-10T04:53:36.149717Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-10T04:52:36Z/82