2026-09-09T21:26:45.899911Z info ads Push debounce stable[88] 1 for config Secret/opendatahub/maas-controller-metrics-tls: 101.043065ms since last change, 101.043004ms since last push, full=false 2026-09-09T21:26:45.899977Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:26:45Z/54 2026-09-09T21:26:47.763013Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {}, "outbound|8443||maas-controller-metrics.opendatahub.svc.cluster.local": {} } } 2026-09-09T21:26:49.358398Z info ads Push debounce stable[89] 7 for config ConfigMap/ai-tenants/kube-root-ca.crt and 3 more configs: 100.8779ms since last change, 219.030886ms since last push, full=false 2026-09-09T21:26:49.358497Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:26:45Z/54 2026-09-09T21:26:49.805653Z info model Full push, new service opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local 2026-09-09T21:26:49.809837Z info model Full push, new service opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local 2026-09-09T21:26:49.910866Z info ads Push debounce stable[90] 2 for config ServiceEntry/opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local and 1 more configs: 100.988979ms since last change, 105.163196ms since last push, full=true 2026-09-09T21:26:49.911412Z info ads XDS: Pushing Services:96 ConnectedEndpoints:2 Version:2026-09-09T21:26:49Z/55 2026-09-09T21:26:49.911997Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:4 removed:0 size:2.5kB cached:0/2 2026-09-09T21:26:49.912073Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 2026-09-09T21:26:49.912117Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-09T21:26:49.912197Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:147B empty:0 cached:2/2 2026-09-09T21:26:49.912355Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T21:26:49.912411Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:26:49.912413Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T21:26:49.912524Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T21:26:49.912485Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:26:57.763170Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {}, "outbound|8443||maas-controller-metrics.opendatahub.svc.cluster.local": {} } } 2026-09-09T21:27:01.008697Z info ads Push debounce stable[91] 6 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.041934ms since last change, 204.76173ms since last push, full=false 2026-09-09T21:27:01.008767Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:26:49Z/55 2026-09-09T21:27:01.268221Z info ads Push debounce stable[92] 2 for config ServiceEntry/opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local and 1 more configs: 100.220674ms since last change, 100.224095ms since last push, full=false 2026-09-09T21:27:01.268273Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:26:49Z/55 2026-09-09T21:27:21.304805Z info ads Push debounce stable[93] 7 for config ConfigMap/models-as-a-service/kube-root-ca.crt and 3 more configs: 101.059512ms since last change, 229.84599ms since last push, full=false 2026-09-09T21:27:21.304878Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:26:49Z/55 2026-09-09T21:27:22.731267Z info model Incremental push, service maas-api.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:27:22.755433Z info model Incremental push, service maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:27:22.856399Z info ads Push debounce stable[94] 4 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.915098ms since last change, 137.052997ms since last push, full=true 2026-09-09T21:27:22.856962Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-09-09T21:27:22Z/56 2026-09-09T21:27:22.857533Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:3 removed:0 size:2.3kB cached:0/2 2026-09-09T21:27:22.857534Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:4 removed:0 size:2.7kB cached:0/2 2026-09-09T21:27:22.857822Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:22.857957Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:22.858012Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T21:27:22.858032Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T21:27:22.858051Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T21:27:22.863884Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 filtered:124 2026-09-09T21:27:22.864173Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 filtered:124 2026-09-09T21:27:23.064506Z info ads Push debounce stable[95] 5 for config Secret/odh-ai-gateway-infra/maas-api-cleanup-dockercfg-6vdzw and 2 more configs: 100.963608ms since last change, 197.047158ms since last push, full=false 2026-09-09T21:27:23.064585Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:27:22Z/56 2026-09-09T21:27:23.168098Z info ads Push debounce stable[96] 1 for config Secret/odh-ai-gateway-infra/maas-api-metrics-tls: 100.882489ms since last change, 100.882435ms since last push, full=false 2026-09-09T21:27:23.168156Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:27:22Z/56 2026-09-09T21:27:23.353814Z info ads Push debounce stable[97] 1 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~*: 100.408855ms since last change, 100.40879ms since last push, full=true 2026-09-09T21:27:23.353951Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-09-09T21:27:23Z/57 2026-09-09T21:27:23.354476Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T21:27:23.354511Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:23.354619Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:23.354636Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:3.2kB cached:0/0 2026-09-09T21:27:23.452709Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:27:23.537798Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:27:23.780887Z info ads Push debounce stable[98] 13 for config DestinationRule/openshift-ingress/payload-pre-processing and 9 more configs: 100.808742ms since last change, 411.685821ms since last push, full=true 2026-09-09T21:27:23.783711Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T21:27:23Z/58 2026-09-09T21:27:23.785065Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:129 removed:0 size:149.2kB cached:118/128 2026-09-09T21:27:23.785687Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:126 removed:0 size:29.8kB empty:1 cached:125/126 2026-09-09T21:27:23.786068Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:23.786176Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:23.786225Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:27:23.788151Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:132 removed:0 size:149.7kB cached:0/128 2026-09-09T21:27:23.788646Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:126 removed:0 size:29.8kB empty:0 cached:126/126 2026-09-09T21:27:23.788840Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:27:23.789052Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T21:27:23.789082Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:27:23.802952Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:126 2026-09-09T21:27:23.807943Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:126 2026-09-09T21:27:24.566483Z info ads Push debounce stable[99] 1 for config EnvoyFilter/openshift-ingress/payload-processing: 100.242347ms since last change, 100.242231ms since last push, full=true 2026-09-09T21:27:24.567468Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T21:27:24Z/59 2026-09-09T21:27:24.568587Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T21:27:24.568604Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:132 removed:0 size:149.7kB cached:128/128 2026-09-09T21:27:24.569299Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T21:27:24.569313Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T21:27:24.569567Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:27:24.569572Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:24.569767Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:24.569781Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T21:27:26.010545Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T21:27:26.014488Z info model Full push, new service odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T21:27:26.114640Z info ads Push debounce stable[100] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.07977ms since last change, 104.02519ms since last push, full=true 2026-09-09T21:27:26.115279Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T21:27:26Z/60 2026-09-09T21:27:26.116019Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:3 removed:0 size:2.4kB cached:0/2 2026-09-09T21:27:26.116184Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 2026-09-09T21:27:26.116072Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:6 removed:0 size:3.0kB cached:0/2 2026-09-09T21:27:26.116412Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 2026-09-09T21:27:26.116493Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:26.116591Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:26.116684Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:27:26.116983Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T21:27:26.979030Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-09T21:27:26.999643Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-09T21:27:27.099992Z info ads Push debounce stable[101] 2 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.29558ms since last change, 120.910618ms since last push, full=true 2026-09-09T21:27:27.100546Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T21:27:27Z/61 2026-09-09T21:27:27.101298Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-09T21:27:27.101309Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:6 removed:0 size:2.8kB cached:0/2 2026-09-09T21:27:27.101388Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 2026-09-09T21:27:27.101411Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:2 removed:0 size:146B empty:1 cached:1/2 2026-09-09T21:27:27.101595Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:27.101606Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:27:27.101667Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:27.101844Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T21:27:27.763149Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|9004||payload-pre-processing.openshift-ingress.svc.cluster.local": {}, "outbound|9004||payload-processing.openshift-ingress.svc.cluster.local": {} } } 2026-09-09T21:27:32.127311Z info ads Push debounce stable[102] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.75927ms since last change, 104.219672ms since last push, full=false 2026-09-09T21:27:32.127403Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:27:27Z/61 2026-09-09T21:27:33.075415Z info ads Push debounce stable[103] 8 for config ConfigMap/llm/kube-root-ca.crt and 4 more configs: 100.497391ms since last change, 169.825076ms since last push, full=true 2026-09-09T21:27:33.075558Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T21:27:33Z/62 2026-09-09T21:27:33.076928Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:129 removed:0 size:149.2kB cached:126/128 2026-09-09T21:27:33.076928Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-09T21:27:33.077620Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:128 removed:0 size:30.3kB empty:0 cached:128/128 2026-09-09T21:27:33.077694Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:128 removed:0 size:30.3kB empty:0 cached:128/128 2026-09-09T21:27:33.077861Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:33.077923Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:27:33.077940Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:33.077971Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:27:33.078160Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T21:27:33.078189Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:27:33.300339Z info delta ADS: "10.132.0.41:43174" maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress-2 terminated 2026-09-09T21:27:34.146211Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:27:34.146239Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:27:34.192978Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress-3 2026-09-09T21:27:34.193751Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-09T21:27:34.206101Z info ads Push debounce stable[104] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.186208ms since last change, 100.186144ms since last push, full=false 2026-09-09T21:27:34.206151Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:27:33Z/62 2026-09-09T21:27:34.242285Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:27:34.268097Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 filtered:0 2026-09-09T21:27:34.415804Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:27:34.423048Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-09T21:27:34.423172Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-09T21:27:37.763074Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|15021||maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local": {}, "outbound|443||maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local": {} } } 2026-09-09T21:27:38.126581Z info ads Push debounce stable[105] 2 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.816043ms since last change, 129.236803ms since last push, full=false 2026-09-09T21:27:38.126660Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:27:33Z/62 2026-09-09T21:27:39.568175Z info ads Push debounce stable[106] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.563638ms since last change, 100.563587ms since last push, full=false 2026-09-09T21:27:39.568246Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:27:33Z/62 2026-09-09T21:27:39.706913Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:27:39.875277Z info ads Push debounce stable[107] 3 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.44592ms since last change, 177.586351ms since last push, full=true 2026-09-09T21:27:39.875839Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T21:27:39Z/63 2026-09-09T21:27:39.876510Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T21:27:39.876509Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T21:27:39.876816Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:39.876900Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T21:27:39.876920Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:39.877404Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T21:27:39.881927Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-09T21:27:40.021002Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-09T21:27:40.425181Z info ads Push debounce stable[108] 2 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc and 1 more configs: 100.058611ms since last change, 180.446473ms since last push, full=true 2026-09-09T21:27:40.428463Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T21:27:40Z/64 2026-09-09T21:27:40.429894Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:130 removed:0 size:150.4kB cached:124/129 2026-09-09T21:27:40.430305Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:129 removed:0 size:30.3kB empty:1 cached:128/129 2026-09-09T21:27:40.430606Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:40.430682Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:40.433347Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:133 removed:0 size:151.0kB cached:0/129 2026-09-09T21:27:40.433846Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:129 removed:0 size:30.3kB empty:0 cached:129/129 2026-09-09T21:27:40.434111Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T21:27:40.434463Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T21:27:40.758384Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:133 removed:0 size:151.0kB cached:129/129 2026-09-09T21:27:40.758880Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:129 removed:0 size:30.3kB empty:0 cached:129/129 2026-09-09T21:27:40.759199Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T21:27:40.759615Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T21:27:40.759657Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:27:40.780264Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:27:40.780297Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:27:40.826216Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T21:27:40.877332Z info ads Push debounce stable[109] 3 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-dd596 and 1 more configs: 100.674157ms since last change, 119.232032ms since last push, full=false 2026-09-09T21:27:40.877408Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:27:40Z/64 2026-09-09T21:27:41.435350Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:27:41.535652Z info ads Push debounce stable[110] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.222997ms since last change, 100.222929ms since last push, full=true 2026-09-09T21:27:41.536181Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T21:27:41Z/65 2026-09-09T21:27:41.536787Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:27:41.536864Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-09-09T21:27:41.536789Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:27:41.537002Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-09-09T21:27:41.537089Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:41.537168Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:41.537517Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T21:27:41.537912Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T21:27:43.488277Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:27:43.625228Z info ads Push debounce stable[111] 5 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs and 3 more configs: 101.07721ms since last change, 177.51448ms since last push, full=true 2026-09-09T21:27:43.625837Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T21:27:43Z/66 2026-09-09T21:27:43.626426Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:27:43.626427Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:27:43.626996Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T21:27:43.627106Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T21:27:43.627423Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:43.627524Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:43.627564Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:27:43.627578Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T21:27:43.628050Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T21:27:43.628082Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:27:43.631043Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-09T21:27:43.631286Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-09T21:27:44.556567Z info ads Push debounce stable[112] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.109882ms since last change, 100.109821ms since last push, full=true 2026-09-09T21:27:44.561443Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T21:27:44Z/67 2026-09-09T21:27:44.562756Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:131 removed:0 size:151.5kB cached:128/130 2026-09-09T21:27:44.563472Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T21:27:44.563829Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:44.563959Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:44.566693Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-09T21:27:44.567200Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T21:27:44.567572Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T21:27:44.568111Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T21:27:46.156405Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:27:46.256911Z info ads Push debounce stable[113] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.454881ms since last change, 100.454813ms since last push, full=true 2026-09-09T21:27:46.257521Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T21:27:46Z/68 2026-09-09T21:27:46.258117Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:27:46.258177Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:27:46.258188Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-09T21:27:46.258240Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-09T21:27:46.258444Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:27:46.258539Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:27:46.258686Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T21:27:46.259342Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T21:27:47.763770Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T21:28:22.228234Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:28:22.359570Z info ads Push debounce stable[114] 4 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs and 2 more configs: 100.769917ms since last change, 191.616811ms since last push, full=true 2026-09-09T21:28:22.360130Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T21:28:22Z/69 2026-09-09T21:28:22.360785Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T21:28:22.360786Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T21:28:22.361066Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:22.361157Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:22.361199Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:28:22.361436Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T21:28:22.362078Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T21:28:22.362110Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:28:22.368132Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-09T21:28:22.368153Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-09T21:28:22.550071Z info ads Push debounce stable[115] 1 for config DestinationRule/llm/e2e-embedding-simulated-kserve-workload-svc: 100.226036ms since last change, 100.225963ms since last push, full=true 2026-09-09T21:28:22.550226Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T21:28:22Z/70 2026-09-09T21:28:22.550788Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:28:22.550788Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:28:22.551388Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T21:28:22.551510Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:131 removed:0 size:30.8kB empty:1 cached:130/131 2026-09-09T21:28:22.551732Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:22.551766Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T21:28:22.551809Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:22.552450Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T21:28:23.468194Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:28:23.579421Z info ads Push debounce stable[116] 2 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.795081ms since last change, 111.179431ms since last push, full=true 2026-09-09T21:28:23.586241Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T21:28:23Z/71 2026-09-09T21:28:23.587646Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:132 removed:0 size:152.7kB cached:130/131 2026-09-09T21:28:23.588727Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:131 removed:0 size:30.8kB empty:1 cached:130/131 2026-09-09T21:28:23.589093Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:23.589208Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:23.591568Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-09T21:28:23.592115Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T21:28:23.592518Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T21:28:23.593141Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T21:28:27.763130Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T21:28:33.586410Z info ads Push debounce stable[117] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.055935ms since last change, 100.055811ms since last push, full=false 2026-09-09T21:28:33.586475Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:28:23Z/71 2026-09-09T21:28:35.989098Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:28:36.175339Z info ads Push debounce stable[118] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.849237ms since last change, 221.058209ms since last push, full=true 2026-09-09T21:28:36.175960Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T21:28:36Z/72 2026-09-09T21:28:36.176515Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:28:36.176516Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:28:36.177102Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:131 removed:0 size:31.0kB empty:0 cached:131/131 2026-09-09T21:28:36.177181Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:131 removed:0 size:31.0kB empty:0 cached:131/131 2026-09-09T21:28:36.177420Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:36.177502Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:36.177531Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:28:36.177575Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T21:28:36.178485Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T21:28:36.178531Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:28:36.181242Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-09T21:28:36.181545Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-09T21:28:37.721677Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:28:37.763020Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T21:28:37.822170Z info ads Push debounce stable[119] 2 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway and 1 more configs: 100.446881ms since last change, 173.415369ms since last push, full=true 2026-09-09T21:28:37.830670Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T21:28:37Z/73 2026-09-09T21:28:37.831815Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:133 removed:0 size:153.9kB cached:130/132 2026-09-09T21:28:37.832812Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:132 removed:0 size:31.1kB empty:1 cached:131/132 2026-09-09T21:28:37.833041Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:37.833143Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:37.834643Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-09T21:28:37.835059Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T21:28:37.835438Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T21:28:37.836088Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T21:28:42.606438Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:28:42.783922Z info ads Push debounce stable[120] 4 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local and 2 more configs: 100.978922ms since last change, 229.206353ms since last push, full=true 2026-09-09T21:28:42.784525Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T21:28:42Z/74 2026-09-09T21:28:42.785146Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:2.1kB cached:0/1 2026-09-09T21:28:42.785172Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.5kB cached:0/1 2026-09-09T21:28:42.785466Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:42.785541Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:42.785578Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:28:42.785697Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T21:28:42.786797Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T21:28:42.786846Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:28:42.790638Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-09T21:28:42.790849Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-09T21:28:42.948588Z info ads Push debounce stable[121] 1 for config DestinationRule/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc: 100.143289ms since last change, 100.143172ms since last push, full=true 2026-09-09T21:28:42.948789Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T21:28:42Z/75 2026-09-09T21:28:42.949389Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T21:28:42.949389Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T21:28:42.950154Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:133 removed:0 size:31.2kB empty:1 cached:132/133 2026-09-09T21:28:42.950185Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T21:28:42.950569Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T21:28:42.950569Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:42.950837Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:42.951460Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T21:28:45.074870Z info ads Push debounce stable[122] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.219333ms since last change, 100.219255ms since last push, full=true 2026-09-09T21:28:45.084438Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T21:28:45Z/76 2026-09-09T21:28:45.085432Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:134 removed:0 size:155.2kB cached:133/133 2026-09-09T21:28:45.085958Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T21:28:45.086170Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:45.086243Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:45.088252Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-09T21:28:45.088729Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T21:28:45.089062Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T21:28:45.089910Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T21:28:45.334043Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:28:45.434316Z info ads Push debounce stable[123] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.215703ms since last change, 100.215627ms since last push, full=true 2026-09-09T21:28:45.434874Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T21:28:45Z/77 2026-09-09T21:28:45.435472Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T21:28:45.435564Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-09-09T21:28:45.435657Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T21:28:45.435713Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 2026-09-09T21:28:45.435840Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:45.435965Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:45.436161Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T21:28:45.437159Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T21:28:46.894912Z info ads Push debounce stable[124] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.185755ms since last change, 100.185632ms since last push, full=false 2026-09-09T21:28:46.894968Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:28:45Z/77 2026-09-09T21:28:47.762908Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T21:28:52.518543Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:28:52.690581Z info ads Push debounce stable[125] 5 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local and 3 more configs: 100.228382ms since last change, 225.493ms since last push, full=true 2026-09-09T21:28:52.691231Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T21:28:52Z/78 2026-09-09T21:28:52.691888Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:28:52.691957Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:28:52.692493Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:133 removed:0 size:31.3kB empty:0 cached:133/133 2026-09-09T21:28:52.692566Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:133 removed:0 size:31.3kB empty:0 cached:133/133 2026-09-09T21:28:52.692739Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:52.692835Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:52.692879Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:28:52.693032Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T21:28:52.694126Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T21:28:52.694164Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:28:52.696545Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-09T21:28:52.696915Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-09T21:28:53.480337Z info ads Push debounce stable[126] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 101.069094ms since last change, 101.069034ms since last push, full=false 2026-09-09T21:28:53.480417Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:28:52Z/78 2026-09-09T21:28:53.794519Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:28:53.895264Z info ads Push debounce stable[127] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.68841ms since last change, 100.688296ms since last push, full=true 2026-09-09T21:28:53.895850Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T21:28:53Z/79 2026-09-09T21:28:53.896453Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T21:28:53.896546Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-09T21:28:53.896597Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T21:28:53.896653Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 2026-09-09T21:28:53.896878Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:53.896970Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:53.897185Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T21:28:53.898270Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T21:28:54.965413Z info ads Push debounce stable[128] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.224173ms since last change, 100.224113ms since last push, full=true 2026-09-09T21:28:54.977581Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T21:28:54Z/80 2026-09-09T21:28:54.978904Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:135 removed:0 size:156.3kB cached:132/134 2026-09-09T21:28:54.980171Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T21:28:54.980491Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:28:54.980673Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:28:54.982839Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-09T21:28:54.983480Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T21:28:54.983840Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T21:28:54.984851Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T21:28:57.763570Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T21:29:09.009054Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:29:09.172194Z info ads Push debounce stable[129] 5 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs and 3 more configs: 100.104415ms since last change, 218.848599ms since last push, full=true 2026-09-09T21:29:09.172832Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T21:29:09Z/81 2026-09-09T21:29:09.173478Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T21:29:09.173545Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T21:29:09.174100Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T21:29:09.174160Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T21:29:09.174335Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:29:09.174460Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:29:09.174498Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T21:29:09.174674Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T21:29:09.175926Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T21:29:09.175959Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T21:29:09.178774Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-09T21:29:09.180529Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 filtered:134 2026-09-09T21:29:10.092418Z info model Incremental push, service kserve-controller-manager-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:29:10.092462Z info model Incremental push, service kserve-controller-manager-metrics-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T21:29:10.193516Z info ads Push debounce stable[130] 2 for config ServiceEntry/opendatahub/kserve-controller-manager-service.opendatahub.svc.cluster.local and 1 more configs: 100.98978ms since last change, 100.993632ms since last push, full=false 2026-09-09T21:29:10.193574Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:29:09Z/81 2026-09-09T21:29:10.881201Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T21:29:10.981480Z info ads Push debounce stable[131] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.219088ms since last change, 100.219034ms since last push, full=true 2026-09-09T21:29:10.982061Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T21:29:10Z/82 2026-09-09T21:29:10.982662Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T21:29:10.982741Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-09T21:29:10.982664Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T21:29:10.982892Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-09-09T21:29:10.982984Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:29:10.983057Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:29:10.983339Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T21:29:10.984669Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T21:29:12.065787Z info ads Push debounce stable[132] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.223467ms since last change, 100.223403ms since last push, full=true 2026-09-09T21:29:12.079484Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T21:29:12Z/83 2026-09-09T21:29:12.080623Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:136 removed:0 size:157.6kB cached:133/135 2026-09-09T21:29:12.081287Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T21:29:12.081517Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T21:29:12.081603Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-8lbdb.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T21:29:12.084151Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-09T21:29:12.084597Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T21:29:12.084937Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-09T21:29:12.086017Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T21:29:17.763460Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-5qzpn.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T21:29:19.459695Z info ads Push debounce stable[133] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.21886ms since last change, 100.21881ms since last push, full=false 2026-09-09T21:29:19.459759Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:29:12Z/83 2026-09-09T21:29:24.453602Z info ads Push debounce stable[134] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.245197ms since last change, 100.245127ms since last push, full=false 2026-09-09T21:29:24.453686Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:29:12Z/83 2026-09-09T21:29:36.563418Z info ads Push debounce stable[135] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.224361ms since last change, 100.224309ms since last push, full=false 2026-09-09T21:29:36.563487Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:29:12Z/83 2026-09-09T21:29:45.649238Z info ads Push debounce stable[136] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.216049ms since last change, 100.21598ms since last push, full=false 2026-09-09T21:29:45.649298Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:29:12Z/83 2026-09-09T21:29:50.461835Z info ads Push debounce stable[137] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.842613ms since last change, 100.842549ms since last push, full=false 2026-09-09T21:29:50.461890Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:29:12Z/83 2026-09-09T21:29:56.459608Z info ads Push debounce stable[138] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.181804ms since last change, 100.181732ms since last push, full=false 2026-09-09T21:29:56.459670Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:29:12Z/83 2026-09-09T21:30:07.867671Z info ads Push debounce stable[139] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.75782ms since last change, 100.757744ms since last push, full=false 2026-09-09T21:30:07.867734Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T21:29:12Z/83