2026-09-09T23:12:52.880694Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:12:52.880785Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:12:52.886461Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 filtered:124 2026-09-09T23:12:52.886552Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 filtered:124 2026-09-09T23:12:53.112296Z info ads Push debounce stable[87] 5 for config Secret/odh-ai-gateway-infra/maas-api-serving-cert and 2 more configs: 100.026334ms since last change, 177.850526ms since last push, full=false 2026-09-09T23:12:53.112379Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:12:52Z/50 2026-09-09T23:12:53.214628Z info ads Push debounce stable[88] 1 for config Secret/odh-ai-gateway-infra/maas-api-metrics-tls: 100.888316ms since last change, 100.888232ms since last push, full=false 2026-09-09T23:12:53.214687Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:12:52Z/50 2026-09-09T23:12:53.478549Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:12:53.534750Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:12:53.716512Z info ads Push debounce stable[89] 11 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 7 more configs: 101.051269ms since last change, 386.634795ms since last push, full=true 2026-09-09T23:12:53.717830Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:12:53Z/51 2026-09-09T23:12:53.719041Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:130 removed:0 size:149.5kB cached:118/128 2026-09-09T23:12:53.719068Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:129 removed:0 size:149.2kB cached:118/128 2026-09-09T23:12:53.719958Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:126 removed:0 size:29.8kB empty:1 cached:125/126 2026-09-09T23:12:53.720031Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:126 removed:0 size:29.8kB empty:0 cached:126/126 2026-09-09T23:12:53.720283Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:12:53.720341Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.3kB 2026-09-09T23:12:53.720546Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:12:53.720627Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:12:53.720767Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:12:53.720798Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:12:53.731461Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:126 2026-09-09T23:12:53.732912Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:126 2026-09-09T23:12:53.822995Z info ads Push debounce stable[90] 2 for config EnvoyFilter/openshift-ingress/kuadrant-auth-maas-default-gateway and 1 more configs: 100.107239ms since last change, 100.307287ms since last push, full=true 2026-09-09T23:12:53.823566Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:12:53Z/52 2026-09-09T23:12:53.824601Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T23:12:53.825202Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:12:53.825520Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:12:53.825645Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:12:53.829509Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:131 removed:0 size:149.6kB cached:0/128 2026-09-09T23:12:53.830329Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:12:53.830692Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.3kB 2026-09-09T23:12:53.831031Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:12:53.947991Z info ads Push debounce stable[91] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.795628ms since last change, 100.795563ms since last push, full=true 2026-09-09T23:12:53.949447Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:12:53Z/53 2026-09-09T23:12:53.950274Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T23:12:53.950839Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:12:53.951051Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:12:53.951135Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:12:53.954542Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:132 removed:0 size:149.7kB cached:0/128 2026-09-09T23:12:53.955333Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:12:53.955701Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:12:53.956041Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:12:54.995916Z info ads Push debounce stable[92] 1 for config EnvoyFilter/openshift-ingress/payload-processing: 100.226592ms since last change, 100.226524ms since last push, full=true 2026-09-09T23:12:54.996894Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:12:54Z/54 2026-09-09T23:12:54.997962Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:129 removed:0 size:149.2kB cached:128/128 2026-09-09T23:12:54.997980Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:132 removed:0 size:149.7kB cached:128/128 2026-09-09T23:12:54.998700Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:12:54.998881Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:128 removed:0 size:30.0kB empty:0 cached:128/128 2026-09-09T23:12:54.998960Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:12:54.999070Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:12:54.999144Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:12:54.999478Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:12:56.205119Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T23:12:56.205177Z info model Full push, new service odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local 2026-09-09T23:12:56.305619Z info ads Push debounce stable[93] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.410891ms since last change, 100.414499ms since last push, full=true 2026-09-09T23:12:56.306181Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:12:56Z/55 2026-09-09T23:12:56.306777Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:3 removed:0 size:2.4kB cached:0/2 2026-09-09T23:12:56.306799Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:6 removed:0 size:3.0kB cached:0/2 2026-09-09T23:12:56.306853Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 2026-09-09T23:12:56.306868Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 2026-09-09T23:12:56.307081Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:12:56.307170Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:12:56.307083Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:12:56.307447Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:12:57.261843Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-09T23:12:57.279046Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-09T23:12:57.380135Z info ads Push debounce stable[94] 2 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.952823ms since last change, 118.225549ms since last push, full=true 2026-09-09T23:12:57.380679Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:12:57Z/56 2026-09-09T23:12:57.381299Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:6 removed:0 size:2.8kB cached:0/2 2026-09-09T23:12:57.381380Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-09T23:12:57.381394Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 2026-09-09T23:12:57.381456Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 2026-09-09T23:12:57.381680Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:12:57.381768Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:12:57.381684Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:12:57.381997Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:12:59.284309Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|9004||payload-pre-processing.openshift-ingress.svc.cluster.local": {}, "outbound|9004||payload-processing.openshift-ingress.svc.cluster.local": {} } } 2026-09-09T23:13:02.320331Z info ads Push debounce stable[95] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.474665ms since last change, 100.47768ms since last push, full=false 2026-09-09T23:13:02.320392Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:12:57Z/56 2026-09-09T23:13:03.272273Z info ads Push debounce stable[96] 8 for config ConfigMap/llm/kube-root-ca.crt and 4 more configs: 100.581794ms since last change, 158.113814ms since last push, full=true 2026-09-09T23:13:03.272428Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-09T23:13:03Z/57 2026-09-09T23:13:03.273816Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-09T23:13:03.273816Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:129 removed:0 size:149.2kB cached:126/128 2026-09-09T23:13:03.274471Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:128 removed:0 size:30.3kB empty:0 cached:128/128 2026-09-09T23:13:03.274774Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:13:03.275113Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:13:03.275164Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:13:03.275120Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:128 removed:0 size:30.3kB empty:0 cached:128/128 2026-09-09T23:13:03.275431Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:03.275517Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:03.275562Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:13:03.580366Z info delta ADS: "10.133.0.39:34514" maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress-2 terminated 2026-09-09T23:13:04.330143Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:13:04.330174Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:13:04.376026Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:13:04.420447Z info ads Push debounce stable[97] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.363796ms since last change, 100.363708ms since last push, full=false 2026-09-09T23:13:04.420507Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-09-09T23:13:03Z/57 2026-09-09T23:13:04.445434Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress-3 2026-09-09T23:13:04.446242Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-09T23:13:04.523366Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 filtered:0 2026-09-09T23:13:04.574920Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:13:04.582893Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-09T23:13:04.582982Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-09T23:13:09.283831Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|15021||maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local": {}, "outbound|443||maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local": {} } } 2026-09-09T23:13:09.399476Z info ads Push debounce stable[98] 2 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.909468ms since last change, 116.587436ms since last push, full=false 2026-09-09T23:13:09.399537Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:13:03Z/57 2026-09-09T23:13:10.371141Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-09T23:13:10.371622Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:128 removed:0 size:30.2kB empty:0 cached:128/128 2026-09-09T23:13:10.371848Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:13:10.372060Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-09T23:13:10.372090Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:13:10.393877Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:13:10.393907Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:13:10.442968Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-09T23:13:10.477987Z info ads Push debounce stable[99] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.865186ms since last change, 100.865126ms since last push, full=false 2026-09-09T23:13:10.478065Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:13:03Z/57 2026-09-09T23:13:24.343810Z info ads Push debounce stable[100] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.102673ms since last change, 100.102612ms since last push, full=false 2026-09-09T23:13:24.343880Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:13:03Z/57 2026-09-09T23:13:24.489845Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:13:24.660117Z info ads Push debounce stable[101] 3 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.342436ms since last change, 180.045246ms since last push, full=true 2026-09-09T23:13:24.660703Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:13:24Z/58 2026-09-09T23:13:24.661273Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T23:13:24.661320Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T23:13:24.661551Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:13:24.661607Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:24.661705Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:24.662160Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:13:24.666943Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-09T23:13:24.668723Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-09T23:13:24.840967Z info ads Push debounce stable[102] 1 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc: 100.6461ms since last change, 100.646032ms since last push, full=true 2026-09-09T23:13:24.841134Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:13:24Z/59 2026-09-09T23:13:24.841690Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:13:24.841803Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:13:24.842354Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:129 removed:0 size:30.7kB empty:1 cached:128/129 2026-09-09T23:13:24.842476Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:13:24.842712Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:24.842777Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-09T23:13:24.842871Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:24.843220Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:13:25.160267Z info ads Push debounce stable[103] 3 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-qr5gc and 1 more configs: 100.879744ms since last change, 203.411677ms since last push, full=true 2026-09-09T23:13:25.163523Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:13:25Z/60 2026-09-09T23:13:25.164456Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:130 removed:0 size:150.4kB cached:125/129 2026-09-09T23:13:25.165066Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:13:25.165349Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:25.165445Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:25.165489Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:13:25.167796Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:133 removed:0 size:151.0kB cached:0/129 2026-09-09T23:13:25.168212Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:129 removed:0 size:30.7kB empty:0 cached:129/129 2026-09-09T23:13:25.168466Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:13:25.168867Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:13:25.168902Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:13:26.354061Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:13:26.454328Z info ads Push debounce stable[104] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.214009ms since last change, 100.213928ms since last push, full=true 2026-09-09T23:13:26.454880Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-09T23:13:26Z/61 2026-09-09T23:13:26.455471Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:13:26.455519Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:13:26.455550Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-09-09T23:13:26.455620Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-09-09T23:13:26.455835Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:26.455937Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:26.456025Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:13:26.456355Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:13:29.283874Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:13:32.052547Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:13:32.152997Z info ads Push debounce stable[105] 3 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs and 1 more configs: 100.313477ms since last change, 196.36084ms since last push, full=true 2026-09-09T23:13:32.153627Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:13:32Z/62 2026-09-09T23:13:32.154142Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-09T23:13:32.154155Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-09T23:13:32.154539Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:32.154591Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:13:32.154656Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:32.154694Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:13:32.155001Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-09T23:13:32.155041Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:13:32.159557Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-09T23:13:32.160097Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-09T23:13:32.263911Z info ads Push debounce stable[106] 2 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 1 more configs: 100.386893ms since last change, 106.956362ms since last push, full=true 2026-09-09T23:13:32.264055Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:13:32Z/63 2026-09-09T23:13:32.264546Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:13:32.264554Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:13:32.265217Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:130 removed:0 size:30.7kB empty:1 cached:129/130 2026-09-09T23:13:32.265636Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-09T23:13:32.265746Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:13:32.265986Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:32.266138Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:32.266327Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:13:33.164588Z info ads Push debounce stable[107] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.230967ms since last change, 100.230891ms since last push, full=true 2026-09-09T23:13:33.169394Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:13:33Z/64 2026-09-09T23:13:33.170235Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:131 removed:0 size:151.5kB cached:130/130 2026-09-09T23:13:33.170749Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:13:33.170969Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:33.171049Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:33.174233Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-09T23:13:33.174942Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:13:33.175315Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:13:33.176040Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:13:33.780304Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:13:33.880628Z info ads Push debounce stable[108] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.267943ms since last change, 100.267856ms since last push, full=true 2026-09-09T23:13:33.881456Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-09T23:13:33Z/65 2026-09-09T23:13:33.882212Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:13:33.882376Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-09T23:13:33.882716Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:13:33.882908Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:13:33.882968Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-09T23:13:33.883253Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:33.883381Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:33.883690Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-09T23:13:39.284329Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:13:41.981506Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:13:42.160068Z info ads Push debounce stable[109] 5 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local and 3 more configs: 101.063527ms since last change, 211.475475ms since last push, full=true 2026-09-09T23:13:42.160703Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:13:42Z/66 2026-09-09T23:13:42.161254Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:13:42.161254Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:13:42.162125Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:13:42.162129Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:130 removed:0 size:30.7kB empty:0 cached:130/130 2026-09-09T23:13:42.162491Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:42.162537Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-09T23:13:42.162623Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:42.162671Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:13:42.163153Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:13:42.163199Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:13:42.165541Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-09T23:13:42.165782Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-09T23:13:43.672287Z info ads Push debounce stable[110] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.218776ms since last change, 100.218721ms since last push, full=true 2026-09-09T23:13:43.679361Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:13:43Z/67 2026-09-09T23:13:43.680702Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:132 removed:0 size:152.7kB cached:131/131 2026-09-09T23:13:43.682193Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:13:43.682558Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:43.682758Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:43.687527Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-09T23:13:43.688114Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:13:43.688416Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:13:43.688954Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:13:44.531561Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:13:44.631888Z info ads Push debounce stable[111] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.234036ms since last change, 100.233981ms since last push, full=true 2026-09-09T23:13:44.632459Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-09T23:13:44Z/68 2026-09-09T23:13:44.633015Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:13:44.633087Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T23:13:44.633018Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:13:44.633256Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-09T23:13:44.633352Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:44.633460Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:44.633798Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:13:44.634365Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-09T23:13:45.039762Z info model Incremental push, service kserve-controller-manager-metrics-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:13:45.039911Z info model Incremental push, service kserve-controller-manager-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:13:45.140178Z info ads Push debounce stable[112] 2 for config ServiceEntry/opendatahub/kserve-controller-manager-metrics-service.opendatahub.svc.cluster.local and 1 more configs: 100.230562ms since last change, 100.233682ms since last push, full=false 2026-09-09T23:13:45.140269Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:13:44Z/68 2026-09-09T23:13:48.094995Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:13:48.243948Z info ads Push debounce stable[113] 5 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs and 3 more configs: 101.060713ms since last change, 197.102639ms since last push, full=true 2026-09-09T23:13:48.244530Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:13:48Z/69 2026-09-09T23:13:48.245052Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:13:48.245147Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:13:48.245753Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:13:48.245782Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:131 removed:0 size:30.8kB empty:0 cached:131/131 2026-09-09T23:13:48.246169Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:48.246261Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:13:48.246282Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:48.246329Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:13:48.247103Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:13:48.247138Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:13:48.249305Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-09T23:13:48.250076Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-09T23:13:49.284071Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-09T23:13:49.473467Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:13:49.574633Z info ads Push debounce stable[114] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.973532ms since last change, 100.97347ms since last push, full=true 2026-09-09T23:13:49.575258Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:13:49Z/70 2026-09-09T23:13:49.575851Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:13:49.575859Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:13:49.575915Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T23:13:49.575927Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-09T23:13:49.576151Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:49.576249Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:49.576463Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-09T23:13:49.577182Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:13:49.878849Z info ads Push debounce stable[115] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 101.067816ms since last change, 101.067747ms since last push, full=true 2026-09-09T23:13:49.887019Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-09T23:13:49Z/71 2026-09-09T23:13:49.887935Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:133 removed:0 size:153.9kB cached:130/132 2026-09-09T23:13:49.888429Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:132 removed:0 size:30.9kB empty:0 cached:132/132 2026-09-09T23:13:49.888743Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:49.888845Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:49.890991Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-09T23:13:49.891428Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:132 removed:0 size:30.9kB empty:0 cached:132/132 2026-09-09T23:13:49.891782Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:13:49.892487Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-09T23:13:52.681922Z info ads Push debounce stable[116] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.966979ms since last change, 100.966922ms since last push, full=false 2026-09-09T23:13:52.681990Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:13:49Z/71 2026-09-09T23:13:55.278206Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:13:55.400602Z info ads Push debounce stable[117] 4 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs and 2 more configs: 100.354736ms since last change, 152.863442ms since last push, full=true 2026-09-09T23:13:55.401219Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:13:55Z/72 2026-09-09T23:13:55.401788Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:2.1kB cached:0/1 2026-09-09T23:13:55.401839Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.5kB cached:0/1 2026-09-09T23:13:55.402132Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:55.402219Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:55.402258Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:13:55.402380Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:13:55.403709Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:13:55.403758Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:13:55.407311Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-09T23:13:55.407626Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-09T23:13:55.542979Z info ads Push debounce stable[118] 1 for config DestinationRule/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc: 100.224108ms since last change, 100.22404ms since last push, full=true 2026-09-09T23:13:55.543140Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:13:55Z/73 2026-09-09T23:13:55.543771Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:13:55.543774Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:13:55.544495Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:133 removed:0 size:31.2kB empty:1 cached:132/133 2026-09-09T23:13:55.544526Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T23:13:55.544792Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:55.544901Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:55.545008Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:13:55.545900Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:13:56.506997Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:13:56.607499Z info ads Push debounce stable[119] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.452719ms since last change, 100.452615ms since last push, full=true 2026-09-09T23:13:56.608106Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:13:56Z/74 2026-09-09T23:13:56.608718Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:13:56.608807Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-09-09T23:13:56.608717Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:13:56.608958Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 2026-09-09T23:13:56.609058Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:56.609145Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:56.609404Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-09T23:13:56.610354Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:13:57.687907Z info ads Push debounce stable[120] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.910897ms since last change, 100.910844ms since last push, full=true 2026-09-09T23:13:57.697952Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-09T23:13:57Z/75 2026-09-09T23:13:57.699003Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:134 removed:0 size:155.2kB cached:132/133 2026-09-09T23:13:57.699684Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T23:13:57.699973Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:13:57.700074Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:13:57.703423Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-09T23:13:57.704776Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:133 removed:0 size:31.2kB empty:0 cached:133/133 2026-09-09T23:13:57.705316Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:13:57.707296Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-09T23:13:58.624744Z info ads Push debounce stable[121] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.093374ms since last change, 100.093293ms since last push, full=false 2026-09-09T23:13:58.624813Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:13:57Z/75 2026-09-09T23:13:59.283631Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:14:04.190090Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:14:04.361484Z info ads Push debounce stable[122] 5 for config DestinationRule/llm/facebook-opt-125m-simulated-kserve-workload-svc and 3 more configs: 100.392226ms since last change, 204.340344ms since last push, full=true 2026-09-09T23:14:04.362150Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:14:04Z/76 2026-09-09T23:14:04.362773Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:14:04.362845Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:14:04.363508Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:133 removed:0 size:31.3kB empty:0 cached:133/133 2026-09-09T23:14:04.363667Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:133 removed:0 size:31.3kB empty:0 cached:133/133 2026-09-09T23:14:04.363799Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:14:04.364011Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:14:04.364054Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:14:04.364060Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:14:04.365007Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:14:04.365050Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:14:04.367104Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-09T23:14:04.367382Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-09T23:14:05.651874Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:14:05.752098Z info ads Push debounce stable[123] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.174251ms since last change, 100.174197ms since last push, full=true 2026-09-09T23:14:05.752705Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:14:05Z/77 2026-09-09T23:14:05.753262Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-09T23:14:05.753285Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-09T23:14:05.753343Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-09T23:14:05.753353Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-09T23:14:05.753694Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:14:05.753789Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:14:05.753922Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-09T23:14:05.754952Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:14:06.387338Z info ads Push debounce stable[124] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.238048ms since last change, 100.237983ms since last push, full=true 2026-09-09T23:14:06.398925Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-09T23:14:06Z/78 2026-09-09T23:14:06.399829Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:135 removed:0 size:156.3kB cached:133/134 2026-09-09T23:14:06.400440Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:134 removed:0 size:31.4kB empty:0 cached:134/134 2026-09-09T23:14:06.400736Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:14:06.400834Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:14:06.403178Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-09T23:14:06.403621Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:134 removed:0 size:31.4kB empty:0 cached:134/134 2026-09-09T23:14:06.403941Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:14:06.404905Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-09T23:14:06.672188Z info ads Push debounce stable[125] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.554444ms since last change, 100.554392ms since last push, full=false 2026-09-09T23:14:06.672242Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:14:06Z/78 2026-09-09T23:14:09.283738Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:14:22.044510Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-09T23:14:22.187617Z info ads Push debounce stable[126] 5 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs and 3 more configs: 100.970098ms since last change, 232.492802ms since last push, full=true 2026-09-09T23:14:22.188245Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:14:22Z/79 2026-09-09T23:14:22.188759Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:14:22.188861Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:14:22.189419Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:14:22.189585Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:134 removed:0 size:31.6kB empty:0 cached:134/134 2026-09-09T23:14:22.189816Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:14:22.189911Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:14:22.189949Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-09T23:14:22.189998Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:14:22.191597Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:14:22.191638Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-09T23:14:22.193423Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-09T23:14:22.193427Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-09T23:14:23.024275Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-09T23:14:23.124550Z info ads Push debounce stable[127] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.216615ms since last change, 100.216556ms since last push, full=true 2026-09-09T23:14:23.125160Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:14:23Z/80 2026-09-09T23:14:23.125697Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-09T23:14:23.125789Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-09T23:14:23.125836Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-09T23:14:23.125904Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-09-09T23:14:23.126044Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:14:23.126154Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:14:23.126355Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-09T23:14:23.127516Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:14:25.092816Z info ads Push debounce stable[128] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.188792ms since last change, 100.188731ms since last push, full=true 2026-09-09T23:14:25.109692Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-09T23:14:25Z/81 2026-09-09T23:14:25.110562Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:136 removed:0 size:157.6kB cached:134/135 2026-09-09T23:14:25.111236Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T23:14:25.111466Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-09T23:14:25.111553Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-09T23:14:25.115555Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-09T23:14:25.116278Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:135 removed:0 size:31.7kB empty:0 cached:135/135 2026-09-09T23:14:25.116999Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-09T23:14:25.118828Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-09T23:14:29.284070Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-78bb78ff78-lzj2s.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-09T23:14:32.149440Z info ads Push debounce stable[129] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.217259ms since last change, 100.217192ms since last push, full=false 2026-09-09T23:14:32.149537Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:14:25Z/81 2026-09-09T23:14:35.856092Z info ads Push debounce stable[130] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.215741ms since last change, 100.215432ms since last push, full=false 2026-09-09T23:14:35.856144Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:14:25Z/81 2026-09-09T23:14:48.350909Z info ads Push debounce stable[131] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.216476ms since last change, 100.216415ms since last push, full=false 2026-09-09T23:14:48.350963Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:14:25Z/81 2026-09-09T23:14:52.555880Z info ads Push debounce stable[132] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.21684ms since last change, 100.216772ms since last push, full=false 2026-09-09T23:14:52.555940Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:14:25Z/81 2026-09-09T23:15:00.750531Z info ads Push debounce stable[133] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.223836ms since last change, 100.223781ms since last push, full=false 2026-09-09T23:15:00.750603Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:14:25Z/81 2026-09-09T23:15:06.151312Z info ads Push debounce stable[134] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.158875ms since last change, 100.158794ms since last push, full=false 2026-09-09T23:15:06.151373Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:14:25Z/81 2026-09-09T23:15:33.955332Z info ads Push debounce stable[135] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.167509ms since last change, 100.167459ms since last push, full=false 2026-09-09T23:15:33.955411Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-09T23:14:25Z/81 2026-09-09T23:16:11.959181Z info rootcertrotator Jitter complete, start rotator.