2026-09-09T23:25:55.352717Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T23:25:55.352789Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:25:55.352896Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:25:55.357117Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 filtered:122 2026-09-09T23:25:55.357253Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:147B empty:0 cached:2/2 filtered:122 2026-09-09T23:25:55.510587Z info ads Push debounce stable[80] 1 for config Secret/opendatahub/maas-controller-metrics-tls: 100.271773ms since last change, 100.271721ms since last push, full=false 2026-09-09T23:25:55.510641Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:25:55Z/48 2026-09-09T23:25:55.703768Z info ads Push debounce stable[81] 1 for config Secret/opendatahub/maas-controller-webhook-cert: 100.994132ms since last change, 100.994063ms since last push, full=false 2026-09-09T23:25:55.703837Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:25:55Z/48 2026-09-09T23:25:58.849199Z info ads Push debounce stable[82] 7 for config ConfigMap/ai-tenants/kube-root-ca.crt and 3 more configs: 100.771251ms since last change, 136.023242ms since last push, full=false 2026-09-09T23:25:58.849250Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:25:55Z/48 2026-09-09T23:25:59.275680Z info model Full push, new service opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local 2026-09-09T23:25:59.275731Z info model Full push, new service opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local 2026-09-09T23:25:59.376101Z info ads Push debounce stable[83] 2 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.335474ms since last change, 100.338862ms since last push, full=true 2026-09-09T23:25:59.376686Z info ads XDS: Pushing Services:96 ConnectedEndpoints:2 Version:2026-09-09T23:25:59Z/49 2026-09-09T23:25:59.377256Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:4 removed:0 size:2.5kB cached:0/2 2026-09-09T23:25:59.377274Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-09T23:25:59.377343Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 2026-09-09T23:25:59.377376Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:147B empty:2 cached:0/2 2026-09-09T23:25:59.377586Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T23:25:59.377610Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T23:25:59.377643Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T23:25:59.377719Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:25:59.377822Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:25:59.431781Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {}, "outbound|8443||maas-controller-metrics.opendatahub.svc.cluster.local": {} } } 2026-09-09T23:26:10.427950Z info ads Push debounce stable[84] 6 for config ServiceEntry/opendatahub/maas-controller-metrics.opendatahub.svc.cluster.local and 1 more configs: 101.009557ms since last change, 144.158023ms since last push, full=false 2026-09-09T23:26:10.428017Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:25:59Z/49 2026-09-09T23:26:10.699582Z info ads Push debounce stable[85] 2 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.039222ms since last change, 100.825259ms since last push, full=false 2026-09-09T23:26:10.699636Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:25:59Z/49 2026-09-09T23:26:30.521182Z info ads Push debounce stable[86] 7 for config Secret/models-as-a-service/default-dockercfg-nsgz8 and 3 more configs: 101.013254ms since last change, 136.304558ms since last push, full=false 2026-09-09T23:26:30.521260Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:25:59Z/49 2026-09-09T23:26:31.784191Z info model Incremental push, service maas-api.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:26:31.809378Z info model Incremental push, service maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:26:32.016271Z info ads Push debounce stable[87] 9 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 4 more configs: 100.924124ms since last change, 238.422749ms since last push, full=true 2026-09-09T23:26:32.016813Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-09-09T23:26:32Z/50 2026-09-09T23:26:32.017380Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:4 removed:0 size:2.7kB cached:0/2 2026-09-09T23:26:32.017390Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:3 removed:0 size:2.3kB cached:0/2 2026-09-09T23:26:32.017602Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:3.9kB 2026-09-09T23:26:32.017620Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:32.017626Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-09-09T23:26:32.017653Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-09-09T23:26:32.017689Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:26:32.017710Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:32.017747Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:26:32.025461Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 filtered:124 2026-09-09T23:26:32.025480Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:136B empty:1 cached:1/2 filtered:124 2026-09-09T23:26:32.250328Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:26:32.301752Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:26:32.475992Z info ads Push debounce stable[88] 11 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 7 more configs: 100.546211ms since last change, 358.785025ms since last push, full=true 2026-09-09T23:26:32.477314Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:26:32Z/51 2026-09-09T23:26:32.478501Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:129 removed:0 size:149.2kB cached:118/128 2026-09-09T23:26:32.478681Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:130 removed:0 size:149.5kB cached:118/128 2026-09-09T23:26:32.479363Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:126 removed:0 size:29.8kB empty:0 cached:126/126 2026-09-09T23:26:32.479516Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:126 removed:0 size:29.8kB empty:1 cached:125/126 2026-09-09T23:26:32.479671Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.3kB 2026-09-09T23:26:32.479803Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:32.479901Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:32.480076Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:26:32.480107Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:26:32.480146Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:26:32.492453Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:126 2026-09-09T23:26:32.493061Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:126 2026-09-09T23:26:32.591772Z info ads Push debounce stable[89] 3 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-maas-default-gateway and 2 more configs: 100.397255ms since last change, 112.179938ms since last push, full=true 2026-09-09T23:26:32.593525Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:26:32Z/52 2026-09-09T23:26:32.594436Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T23:26:32.595022Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:26:32.595301Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:32.595405Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:32.597515Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:132 removed:0 size:149.7kB cached:0/128 2026-09-09T23:26:32.598368Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:26:32.598688Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:26:32.599015Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:26:32.831843Z info ads Push debounce stable[90] 1 for config Secret/odh-ai-gateway-infra/maas-api-metrics-tls: 100.258049ms since last change, 100.257993ms since last push, full=false 2026-09-09T23:26:32.831928Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:26:32Z/52 2026-09-09T23:26:33.071637Z info ads Push debounce stable[91] 1 for config EnvoyFilter/openshift-ingress/payload-processing: 100.985914ms since last change, 100.985865ms since last push, full=true 2026-09-09T23:26:33.072645Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:26:33Z/53 2026-09-09T23:26:33.073511Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T23:26:33.073530Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:132 removed:0 size:149.7kB cached:128/128 2026-09-09T23:26:33.074295Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:26:33.074328Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:26:33.074573Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:33.074634Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:26:33.074717Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:33.075079Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:26:34.995737Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-09T23:26:35.010199Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-09T23:26:35.110618Z info ads Push debounce stable[92] 2 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.280786ms since last change, 114.830063ms since last push, full=true 2026-09-09T23:26:35.111468Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:26:35Z/54 2026-09-09T23:26:35.113391Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:6 removed:0 size:2.8kB cached:0/2 2026-09-09T23:26:35.114261Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 2026-09-09T23:26:35.114743Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:26:35.115258Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:26:35.113875Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-09T23:26:35.115569Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 2026-09-09T23:26:35.115924Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:35.116185Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:36.451717Z info model Full push, new service odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T23:26:36.454463Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T23:26:36.554691Z info ads Push debounce stable[93] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.18596ms since last change, 102.914234ms since last push, full=true 2026-09-09T23:26:36.555280Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:26:36Z/55 2026-09-09T23:26:36.555919Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:3 removed:0 size:2.4kB cached:0/2 2026-09-09T23:26:36.555990Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:6 removed:0 size:3.0kB cached:0/2 2026-09-09T23:26:36.556052Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 2026-09-09T23:26:36.556190Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 2026-09-09T23:26:36.556340Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:36.556444Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:36.556451Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:26:36.556707Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:26:39.432108Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local": {}, "outbound|9090||maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local": {} } } 2026-09-09T23:26:41.669252Z info delta ADS: "10.134.0.41:42322" maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress-2 terminated 2026-09-09T23:26:41.903329Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:26:41.903359Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:26:41.937215Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:26:41.993002Z info ads Push debounce stable[94] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.886253ms since last change, 100.886127ms since last push, full=false 2026-09-09T23:26:41.993068Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-09-09T23:26:36Z/55 2026-09-09T23:26:42.021809Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress-3 2026-09-09T23:26:42.022582Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-09T23:26:42.095538Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:128 removed:0 size:29.6kB empty:0 cached:128/128 filtered:0 2026-09-09T23:26:42.141484Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:26:42.148421Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-09T23:26:42.149039Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-09T23:26:42.566013Z info ads Push debounce stable[95] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.92573ms since last change, 100.929811ms since last push, full=false 2026-09-09T23:26:42.566078Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:26:36Z/55 2026-09-09T23:26:43.474185Z info ads Push debounce stable[96] 8 for config Gateway/openshift-ingress/maas-default-gateway-istio-autogenerated-k8s-gateway-https and 4 more configs: 100.782484ms since last change, 142.9118ms since last push, full=true 2026-09-09T23:26:43.474312Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:26:43Z/56 2026-09-09T23:26:43.475271Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:129 removed:0 size:149.2kB cached:124/128 2026-09-09T23:26:43.475389Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-09T23:26:43.475876Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 2026-09-09T23:26:43.476010Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 2026-09-09T23:26:43.476153Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:43.476274Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:43.476324Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:26:43.476328Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:26:43.476657Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:26:43.476701Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:26:46.123025Z info ads Push debounce stable[97] 2 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 1 more configs: 103.823795ms since last change, 118.809959ms since last push, full=false 2026-09-09T23:26:46.123090Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:26:43Z/56 2026-09-09T23:26:48.584932Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-09T23:26:48.585591Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:128 removed:0 size:30.2kB empty:0 cached:128/128 2026-09-09T23:26:48.585907Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:26:48.586260Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:26:48.586307Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:26:48.601840Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:26:48.601870Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:26:48.633510Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:26:48.691399Z info ads Push debounce stable[98] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.867978ms since last change, 100.867926ms since last push, full=false 2026-09-09T23:26:48.691469Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:26:43Z/56 2026-09-09T23:26:49.431446Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:26:49.454522Z info ads Push debounce stable[99] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.30295ms since last change, 100.302889ms since last push, full=false 2026-09-09T23:26:49.454565Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:26:43Z/56 2026-09-09T23:26:49.588878Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:26:49.706935Z info ads Push debounce stable[100] 3 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.267141ms since last change, 122.493868ms since last push, full=true 2026-09-09T23:26:49.707564Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:26:49Z/57 2026-09-09T23:26:49.708085Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T23:26:49.708099Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T23:26:49.708341Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:49.708440Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:49.708497Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:26:49.709165Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:26:49.713468Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-09T23:26:49.713671Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-09T23:26:49.952330Z info ads Push debounce stable[101] 1 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc: 100.534895ms since last change, 100.534841ms since last push, full=true 2026-09-09T23:26:49.952492Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:26:49Z/58 2026-09-09T23:26:49.953043Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:26:49.953043Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:26:49.953694Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:129 removed:0 size:30.7kB empty:1 cached:128/129 2026-09-09T23:26:49.953753Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:26:49.954001Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:49.954019Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:26:49.954165Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:49.954561Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:26:50.264277Z info ads Push debounce stable[102] 3 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-sjf7n and 1 more configs: 100.19769ms since last change, 204.163294ms since last push, full=true 2026-09-09T23:26:50.267505Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:26:50Z/59 2026-09-09T23:26:50.268521Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:130 removed:0 size:150.4kB cached:125/129 2026-09-09T23:26:50.268996Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:26:50.269329Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:50.269451Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:50.269503Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:26:50.271460Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:133 removed:0 size:151.0kB cached:0/129 2026-09-09T23:26:50.272063Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:26:50.272384Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:26:50.272807Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:26:50.272846Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:26:51.531667Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:26:51.632043Z info ads Push debounce stable[103] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.226177ms since last change, 100.226108ms since last push, full=true 2026-09-09T23:26:51.632580Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:26:51Z/60 2026-09-09T23:26:51.633286Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:26:51.633366Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-09-09T23:26:51.633291Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:26:51.633532Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-09-09T23:26:51.633782Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:51.633808Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:26:51.633912Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:51.634248Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:26:57.263929Z info ads Push debounce stable[104] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.818038ms since last change, 100.817973ms since last push, full=false 2026-09-09T23:26:57.264006Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:26:51Z/60 2026-09-09T23:26:57.273291Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:26:57.400951Z info ads Push debounce stable[105] 4 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local and 2 more configs: 100.533748ms since last change, 133.526108ms since last push, full=true 2026-09-09T23:26:57.401560Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:26:57Z/61 2026-09-09T23:26:57.402078Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:26:57.402094Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:26:57.402827Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:26:57.402846Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:26:57.403213Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:26:57.403289Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:57.403389Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:57.404000Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:26:57.406919Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-09T23:26:57.407000Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-09T23:26:58.274287Z info ads Push debounce stable[106] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.237406ms since last change, 100.237307ms since last push, full=true 2026-09-09T23:26:58.280246Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:26:58Z/62 2026-09-09T23:26:58.281462Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:131 removed:0 size:151.5kB cached:130/130 2026-09-09T23:26:58.282214Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:26:58.282560Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:58.282725Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:58.286065Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-09T23:26:58.286853Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:26:58.287356Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:26:58.288214Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:26:58.983600Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:26:59.083871Z info ads Push debounce stable[107] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.213304ms since last change, 100.213235ms since last push, full=true 2026-09-09T23:26:59.084426Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:26:59Z/63 2026-09-09T23:26:59.085141Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:26:59.085222Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-09T23:26:59.085349Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:26:59.085470Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-09T23:26:59.085860Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:26:59.086001Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:26:59.086118Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:26:59.086756Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:26:59.431154Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:27:12.191015Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:27:12.365409Z info ads Push debounce stable[108] 4 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs and 2 more configs: 100.672292ms since last change, 205.333212ms since last push, full=true 2026-09-09T23:27:12.366053Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:27:12Z/64 2026-09-09T23:27:12.366579Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T23:27:12.366692Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T23:27:12.366962Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:12.367062Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:27:12.367093Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:12.367134Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:27:12.368031Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:27:12.368075Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:27:12.373006Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-09T23:27:12.373217Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-09T23:27:12.553323Z info ads Push debounce stable[109] 1 for config DestinationRule/llm/e2e-embedding-simulated-kserve-workload-svc: 100.220881ms since last change, 100.220805ms since last push, full=true 2026-09-09T23:27:12.553488Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:27:12Z/65 2026-09-09T23:27:12.554288Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:27:12.554296Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:27:12.555084Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:131 removed:0 size:30.8kB empty:1 cached:130/131 2026-09-09T23:27:12.555337Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:27:12.555689Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:12.556231Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:12.556334Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:27:12.558180Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:27:13.630273Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:27:13.731394Z info ads Push debounce stable[110] 2 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 101.060492ms since last change, 150.557043ms since last push, full=true 2026-09-09T23:27:13.738449Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:27:13Z/66 2026-09-09T23:27:13.739454Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:132 removed:0 size:152.7kB cached:130/131 2026-09-09T23:27:13.740326Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:131 removed:0 size:30.8kB empty:1 cached:130/131 2026-09-09T23:27:13.740630Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:13.740761Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:13.742946Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-09T23:27:13.743415Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:27:13.743978Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:27:13.744702Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:27:18.894611Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:27:19.068998Z info ads Push debounce stable[111] 5 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs and 3 more configs: 100.275416ms since last change, 210.318187ms since last push, full=true 2026-09-09T23:27:19.069623Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:27:19Z/67 2026-09-09T23:27:19.070133Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:27:19.070218Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:27:19.070795Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:27:19.070863Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:27:19.071172Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:19.071307Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:27:19.071327Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:19.071621Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:27:19.072238Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:27:19.072285Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:27:19.074754Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-09T23:27:19.074835Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-09T23:27:19.431055Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:27:20.787184Z info ads Push debounce stable[112] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.372242ms since last change, 100.372181ms since last push, full=true 2026-09-09T23:27:20.795247Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:27:20Z/68 2026-09-09T23:27:20.796335Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:133 removed:0 size:153.9kB cached:132/132 2026-09-09T23:27:20.796864Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:132 removed:0 size:30.9kB empty:0 cached:132/132 2026-09-09T23:27:20.797092Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:20.797174Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:20.799517Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-09T23:27:20.800209Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:132 removed:0 size:30.9kB empty:0 cached:132/132 2026-09-09T23:27:20.800698Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:27:20.801558Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:27:21.242464Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:27:21.343531Z info ads Push debounce stable[113] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 101.01537ms since last change, 101.015308ms since last push, full=true 2026-09-09T23:27:21.344191Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:27:21Z/69 2026-09-09T23:27:21.344727Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:27:21.344802Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T23:27:21.344729Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:27:21.344954Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-09T23:27:21.345114Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:21.345213Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:21.345455Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:27:21.346573Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:27:22.794078Z info ads Push debounce stable[114] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.302224ms since last change, 100.302147ms since last push, full=false 2026-09-09T23:27:22.794161Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:21Z/69 2026-09-09T23:27:24.084827Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:27:24.268019Z info ads Push debounce stable[115] 5 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local and 3 more configs: 100.052228ms since last change, 206.702328ms since last push, full=true 2026-09-09T23:27:24.268644Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:27:24Z/70 2026-09-09T23:27:24.269231Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:27:24.269251Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:27:24.269846Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T23:27:24.269994Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:132 removed:0 size:31.1kB empty:0 cached:132/132 2026-09-09T23:27:24.270221Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:24.270368Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:24.270451Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:27:24.270499Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:27:24.271640Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:27:24.271677Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:27:24.274027Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-09T23:27:24.274047Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-09T23:27:25.141247Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:27:25.241522Z info ads Push debounce stable[116] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.205024ms since last change, 100.20497ms since last push, full=true 2026-09-09T23:27:25.242103Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:27:25Z/71 2026-09-09T23:27:25.242663Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:27:25.242732Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-09-09T23:27:25.242664Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:27:25.242888Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 2026-09-09T23:27:25.243021Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:25.243146Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:25.243400Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:27:25.244348Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:27:26.094447Z info ads Push debounce stable[117] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.217917ms since last change, 100.217832ms since last push, full=true 2026-09-09T23:27:26.104840Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:27:26Z/72 2026-09-09T23:27:26.105921Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:134 removed:0 size:155.2kB cached:132/133 2026-09-09T23:27:26.106542Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T23:27:26.106819Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:26.106919Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:26.108815Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-09T23:27:26.109313Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T23:27:26.109646Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:27:26.110518Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:27:29.386167Z info ads Push debounce stable[118] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.064365ms since last change, 100.064293ms since last push, full=false 2026-09-09T23:27:29.386222Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:26Z/72 2026-09-09T23:27:29.431690Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:27:35.312267Z info ads Push debounce stable[119] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 101.018585ms since last change, 101.018523ms since last push, full=false 2026-09-09T23:27:35.312324Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:26Z/72 2026-09-09T23:27:36.096405Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:27:36.254458Z info ads Push debounce stable[120] 5 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs and 3 more configs: 100.988144ms since last change, 187.543559ms since last push, full=true 2026-09-09T23:27:36.255120Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:27:36Z/73 2026-09-09T23:27:36.255739Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:27:36.255937Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:27:36.256399Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-09T23:27:36.256578Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:133 removed:0 size:31.5kB empty:0 cached:133/133 2026-09-09T23:27:36.256653Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:36.256819Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:36.256901Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:27:36.257210Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:27:36.258511Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:27:36.258552Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:27:36.260306Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-09T23:27:36.260642Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-09T23:27:37.756597Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:27:37.857020Z info ads Push debounce stable[121] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.364567ms since last change, 100.364498ms since last push, full=true 2026-09-09T23:27:37.857585Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:27:37Z/74 2026-09-09T23:27:37.858215Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:27:37.858234Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:27:37.858287Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-09T23:27:37.858291Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 2026-09-09T23:27:37.858656Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:37.858763Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:27:37.858789Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:37.860263Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:27:39.007325Z info ads Push debounce stable[122] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.86639ms since last change, 100.866325ms since last push, full=true 2026-09-09T23:27:39.019209Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:27:39Z/75 2026-09-09T23:27:39.020301Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:135 removed:0 size:156.3kB cached:132/134 2026-09-09T23:27:39.020953Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:27:39.021229Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:39.021333Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:39.023604Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-09T23:27:39.024121Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:27:39.024533Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:27:39.025543Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:27:39.431153Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:27:44.463204Z info ads Push debounce stable[123] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.652975ms since last change, 100.652885ms since last push, full=false 2026-09-09T23:27:44.463249Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:39Z/75 2026-09-09T23:27:44.485561Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:27:44.613510Z info ads Push debounce stable[124] 4 for config DestinationRule/llm/premium-simulated-simulated-premium-kserve-workload-svc and 2 more configs: 100.659272ms since last change, 134.348759ms since last push, full=true 2026-09-09T23:27:44.614142Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:27:44Z/76 2026-09-09T23:27:44.614704Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:27:44.614709Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:27:44.615417Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:27:44.615452Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:27:44.615700Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:44.615819Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:44.615842Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:27:44.617344Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:27:44.619239Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-09T23:27:44.619286Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-09T23:27:46.257581Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:27:46.357883Z info ads Push debounce stable[125] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.224197ms since last change, 100.22413ms since last push, full=true 2026-09-09T23:27:46.358506Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:27:46Z/77 2026-09-09T23:27:46.359085Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:27:46.359158Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-09T23:27:46.359084Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:27:46.359242Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-09-09T23:27:46.359536Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:46.359712Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:46.359741Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:27:46.361136Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:27:46.965889Z info ads Push debounce stable[126] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.211138ms since last change, 100.211077ms since last push, full=false 2026-09-09T23:27:46.965945Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:46Z/77 2026-09-09T23:27:47.604912Z info ads Push debounce stable[127] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.213729ms since last change, 100.213667ms since last push, full=true 2026-09-09T23:27:47.618878Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:27:47Z/78 2026-09-09T23:27:47.619936Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:136 removed:0 size:157.6kB cached:135/135 2026-09-09T23:27:47.620561Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T23:27:47.620885Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:27:47.621035Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-nnnw5.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:27:47.623460Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-09T23:27:47.624056Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T23:27:47.624551Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-09T23:27:47.625886Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:27:49.431472Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-rv5wq.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:27:55.541013Z info model Incremental push, service kserve-controller-manager-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:27:55.641294Z info ads Push debounce stable[128] 1 for config ServiceEntry/opendatahub/kserve-controller-manager-service.opendatahub.svc.cluster.local: 100.22672ms since last change, 100.226662ms since last push, full=false 2026-09-09T23:27:55.641355Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:47Z/78 2026-09-09T23:28:00.468403Z info ads Push debounce stable[129] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 101.028832ms since last change, 101.028753ms since last push, full=false 2026-09-09T23:28:00.468470Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:47Z/78 2026-09-09T23:28:25.769137Z info ads Push debounce stable[130] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.211329ms since last change, 100.211229ms since last push, full=false 2026-09-09T23:28:25.769187Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:47Z/78 2026-09-09T23:28:30.864297Z info ads Push debounce stable[131] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 101.072169ms since last change, 101.072091ms since last push, full=false 2026-09-09T23:28:30.864352Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:47Z/78 2026-09-09T23:28:39.967931Z info ads Push debounce stable[132] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.859651ms since last change, 100.859584ms since last push, full=false 2026-09-09T23:28:39.967997Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:47Z/78 2026-09-09T23:28:52.976858Z info ads Push debounce stable[133] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.21456ms since last change, 100.214468ms since last push, full=false 2026-09-09T23:28:52.976910Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:47Z/78 2026-09-09T23:29:00.759342Z info ads Push debounce stable[134] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.227723ms since last change, 100.227627ms since last push, full=false 2026-09-09T23:29:00.759396Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:27:47Z/78