2026-09-19T04:25:49.114698Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-09-19T04:25:49.214980Z info ads Push debounce stable[102] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.243986ms since last change, 100.247563ms since last push, full=true 2026-09-19T04:25:49.215612Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-19T04:25:49Z/58 2026-09-19T04:25:49.216387Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:3 removed:0 size:2.4kB cached:0/2 2026-09-19T04:25:49.216451Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:6 removed:0 size:3.0kB cached:0/2 2026-09-19T04:25:49.216485Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:136B empty:2 cached:0/2 2026-09-19T04:25:49.216536Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:2 removed:0 size:136B empty:0 cached:2/2 2026-09-19T04:25:49.216755Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:25:49.216818Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-19T04:25:49.216832Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:25:49.217079Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-19T04:25:50.131407Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-19T04:25:50.232032Z info ads Push debounce stable[103] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.464299ms since last change, 100.464235ms since last push, full=true 2026-09-19T04:25:50.232557Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-19T04:25:50Z/59 2026-09-19T04:25:50.233325Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-09-19T04:25:50.233413Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:71B empty:1 cached:0/1 2026-09-19T04:25:50.233327Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.7kB cached:0/1 2026-09-19T04:25:50.233579Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:71B empty:0 cached:1/1 2026-09-19T04:25:50.233718Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:25:50.233807Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:25:50.233826Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-19T04:25:50.234067Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-19T04:25:50.714163Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-19T04:25:50.814532Z info ads Push debounce stable[104] 1 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local: 100.220731ms since last change, 100.220679ms since last push, full=true 2026-09-19T04:25:50.815103Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-19T04:25:50Z/60 2026-09-19T04:25:50.815811Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-09-19T04:25:50.815895Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:75B empty:1 cached:0/1 2026-09-19T04:25:50.815932Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.7kB cached:0/1 2026-09-19T04:25:50.815992Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:75B empty:0 cached:1/1 2026-09-19T04:25:50.816168Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:25:50.816176Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-19T04:25:50.816259Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:25:50.816437Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-19T04:25:55.236193Z info ads Push debounce stable[105] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.630093ms since last change, 100.633546ms since last push, full=false 2026-09-19T04:25:55.236273Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:25:50Z/60 2026-09-19T04:25:56.192499Z info ads Push debounce stable[106] 8 for config Secret/llm/default-dockercfg-h5pwl and 4 more configs: 100.336353ms since last change, 155.552631ms since last push, full=true 2026-09-19T04:25:56.192724Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-09-19T04:25:56Z/61 2026-09-19T04:25:56.193730Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-19T04:25:56.193732Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:129 removed:0 size:149.2kB cached:126/128 2026-09-19T04:25:56.194422Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:128 removed:0 size:30.3kB empty:0 cached:128/128 2026-09-19T04:25:56.194565Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:128 removed:0 size:30.3kB empty:0 cached:128/128 2026-09-19T04:25:56.194780Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-19T04:25:56.194780Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:25:56.195030Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:25:56.195048Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-19T04:25:56.195069Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-19T04:25:56.195081Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-19T04:25:56.614704Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-19T04:25:56.652151Z info delta ADS: "10.132.0.42:49230" maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress-2 terminated 2026-09-19T04:25:57.192246Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-19T04:25:57.192282Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-19T04:25:57.241382Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-19T04:25:57.252002Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress-3 2026-09-19T04:25:57.252807Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:132 removed:0 size:149.8kB cached:126/128 2026-09-19T04:25:57.269452Z info ads Push debounce stable[107] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.062245ms since last change, 100.062176ms since last push, full=false 2026-09-19T04:25:57.269501Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:25:56Z/61 2026-09-19T04:25:57.325972Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:128 removed:0 size:29.9kB empty:0 cached:128/128 filtered:0 2026-09-19T04:25:57.372783Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-19T04:25:57.382474Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 filtered:0 2026-09-19T04:25:57.383426Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-09-19T04:26:01.232435Z info ads Push debounce stable[108] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.930521ms since last change, 100.930467ms since last push, full=false 2026-09-19T04:26:01.232509Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:25:56Z/61 2026-09-19T04:26:01.819575Z info ads Push debounce stable[109] 1 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local: 100.67125ms since last change, 100.6712ms since last push, full=false 2026-09-19T04:26:01.819668Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:25:56Z/61 2026-09-19T04:26:03.297394Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:132 removed:0 size:149.8kB cached:124/128 2026-09-19T04:26:03.298167Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:128 removed:0 size:30.2kB empty:0 cached:128/128 2026-09-19T04:26:03.298444Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-19T04:26:03.298793Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.4kB cached:0/0 2026-09-19T04:26:03.298833Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-19T04:26:03.320717Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-09-19T04:26:03.320751Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-09-19T04:26:03.365110Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-09-19T04:26:03.403408Z info ads Push debounce stable[110] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.378468ms since last change, 100.378405ms since last push, full=false 2026-09-19T04:26:03.403487Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:25:56Z/61 2026-09-19T04:26:09.559525Z info ads Push debounce stable[111] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.242382ms since last change, 100.242301ms since last push, full=false 2026-09-19T04:26:09.559608Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:25:56Z/61 2026-09-19T04:26:09.711054Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:26:09.867543Z info ads Push debounce stable[112] 3 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 1 more configs: 100.674467ms since last change, 165.725214ms since last push, full=true 2026-09-19T04:26:09.868118Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-19T04:26:09Z/62 2026-09-19T04:26:09.868706Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-19T04:26:09.868749Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-19T04:26:09.869034Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:09.869064Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:14.2kB 2026-09-19T04:26:09.869138Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:09.869525Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-19T04:26:09.874388Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:128 2026-09-19T04:26:09.874425Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:128 2026-09-19T04:26:10.447663Z info ads Push debounce stable[113] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.217963ms since last change, 100.217874ms since last push, full=true 2026-09-19T04:26:10.450927Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-19T04:26:10Z/63 2026-09-19T04:26:10.451889Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:130 removed:0 size:150.6kB cached:125/129 2026-09-19T04:26:10.452774Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-19T04:26:10.453136Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:10.453301Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:10.454746Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:133 removed:0 size:151.1kB cached:0/129 2026-09-19T04:26:10.455473Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-19T04:26:10.455962Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-19T04:26:10.456295Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-19T04:26:10.554898Z info ads Push debounce stable[114] 1 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc: 100.417008ms since last change, 100.416944ms since last push, full=true 2026-09-19T04:26:10.555048Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-19T04:26:10Z/64 2026-09-19T04:26:10.555570Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-19T04:26:10.555572Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-19T04:26:10.556193Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:129 removed:0 size:30.6kB empty:1 cached:128/129 2026-09-19T04:26:10.556310Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:129 removed:0 size:30.6kB empty:0 cached:129/129 2026-09-19T04:26:10.556402Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:10.556478Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:10.556626Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-19T04:26:10.557000Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-19T04:26:10.694576Z info ads Push debounce stable[115] 2 for config Secret/llm/kserve-metrics-reader-sa-dockercfg-6mgw8: 100.214709ms since last change, 123.526607ms since last push, full=false 2026-09-19T04:26:10.694696Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:26:10Z/64 2026-09-19T04:26:12.224106Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-19T04:26:12.324389Z info ads Push debounce stable[116] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.232998ms since last change, 100.232931ms since last push, full=true 2026-09-19T04:26:12.324957Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-09-19T04:26:12Z/65 2026-09-19T04:26:12.325541Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-19T04:26:12.325582Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-19T04:26:12.325629Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-09-19T04:26:12.325673Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-09-19T04:26:12.326014Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:12.326112Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-19T04:26:12.326177Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:12.326483Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-19T04:26:16.614969Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-19T04:26:20.374348Z info ads Push debounce stable[117] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.498202ms since last change, 100.498137ms since last push, full=false 2026-09-19T04:26:20.374426Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:26:12Z/65 2026-09-19T04:26:23.801370Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:26:23.902338Z info ads Push debounce stable[118] 3 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs and 1 more configs: 100.881456ms since last change, 147.345933ms since last push, full=true 2026-09-19T04:26:23.902970Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-19T04:26:23Z/66 2026-09-19T04:26:23.903502Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-09-19T04:26:23.903506Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-09-19T04:26:23.903805Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:23.903910Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:23.904002Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-19T04:26:23.904110Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-19T04:26:23.904453Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:12.4kB cached:0/0 2026-09-19T04:26:23.904492Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-19T04:26:23.908693Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:129 2026-09-19T04:26:23.908929Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:129 2026-09-19T04:26:24.152357Z info ads Push debounce stable[119] 2 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 1 more configs: 100.985059ms since last change, 193.448801ms since last push, full=true 2026-09-19T04:26:24.152575Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-19T04:26:24Z/67 2026-09-19T04:26:24.153264Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-19T04:26:24.153297Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-19T04:26:24.153937Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:130 removed:0 size:30.9kB empty:1 cached:129/130 2026-09-19T04:26:24.153964Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:130 removed:0 size:30.9kB empty:0 cached:130/130 2026-09-19T04:26:24.154219Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:24.154326Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:24.154394Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:34.3kB 2026-09-19T04:26:24.155016Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-19T04:26:25.023186Z info ads Push debounce stable[120] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.221284ms since last change, 100.221223ms since last push, full=true 2026-09-19T04:26:25.028002Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-19T04:26:25Z/68 2026-09-19T04:26:25.028887Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:131 removed:0 size:151.5kB cached:129/130 2026-09-19T04:26:25.029524Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:130 removed:0 size:30.9kB empty:0 cached:130/130 2026-09-19T04:26:25.029773Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:25.029892Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:25.031913Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:134 removed:0 size:152.1kB cached:0/130 2026-09-19T04:26:25.032521Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:130 removed:0 size:30.9kB empty:0 cached:130/130 2026-09-19T04:26:25.033172Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-19T04:26:25.033716Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-19T04:26:25.871369Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-19T04:26:25.971986Z info ads Push debounce stable[121] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.544058ms since last change, 100.543998ms since last push, full=true 2026-09-19T04:26:25.972576Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-09-19T04:26:25Z/69 2026-09-19T04:26:25.973213Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-19T04:26:25.973286Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-19T04:26:25.973328Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-09-19T04:26:25.973356Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-09-19T04:26:25.973562Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:25.973655Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:25.973803Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-19T04:26:25.974247Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:20.4kB cached:0/0 2026-09-19T04:26:26.614106Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-19T04:26:35.046388Z info ads Push debounce stable[122] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.218505ms since last change, 100.218444ms since last push, full=false 2026-09-19T04:26:35.046449Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:26:25Z/69 2026-09-19T04:26:36.391861Z info model Incremental push, service e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:26:36.650706Z info ads Push debounce stable[123] 5 for config DestinationRule/llm/e2e-embedding-simulated-kserve-workload-svc and 3 more configs: 100.301035ms since last change, 294.190941ms since last push, full=true 2026-09-19T04:26:36.651331Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-19T04:26:36Z/70 2026-09-19T04:26:36.652069Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-19T04:26:36.652069Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-19T04:26:36.652740Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:130 removed:0 size:31.0kB empty:0 cached:130/130 2026-09-19T04:26:36.652805Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:130 removed:0 size:31.0kB empty:0 cached:130/130 2026-09-19T04:26:36.653040Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:36.653158Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:36.653203Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-19T04:26:36.653211Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:54.3kB 2026-09-19T04:26:36.653880Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-19T04:26:36.653928Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-19T04:26:36.657354Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:130 2026-09-19T04:26:36.657358Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:130 2026-09-19T04:26:37.830351Z info ads Push debounce stable[124] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.241845ms since last change, 100.241794ms since last push, full=true 2026-09-19T04:26:37.836931Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-19T04:26:37Z/71 2026-09-19T04:26:37.837813Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:132 removed:0 size:152.7kB cached:130/131 2026-09-19T04:26:37.838830Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:131 removed:0 size:31.1kB empty:0 cached:131/131 2026-09-19T04:26:37.839048Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:37.839140Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:37.841497Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:135 removed:0 size:153.3kB cached:0/131 2026-09-19T04:26:37.842039Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:131 removed:0 size:31.1kB empty:0 cached:131/131 2026-09-19T04:26:37.842357Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-19T04:26:37.843002Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-19T04:26:37.931611Z info model Full push, new service llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-19T04:26:38.031937Z info ads Push debounce stable[125] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.2349ms since last change, 100.234832ms since last push, full=true 2026-09-19T04:26:38.032482Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-09-19T04:26:38Z/72 2026-09-19T04:26:38.033097Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-19T04:26:38.033139Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-19T04:26:38.033186Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-19T04:26:38.033198Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-19T04:26:38.033434Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:38.033516Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:38.033763Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-19T04:26:38.034344Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:28.3kB cached:0/0 2026-09-19T04:26:43.963666Z info ads Push debounce stable[126] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.344886ms since last change, 100.344825ms since last push, full=false 2026-09-19T04:26:43.963741Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:26:38Z/72 2026-09-19T04:26:43.978395Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:26:44.157787Z info ads Push debounce stable[127] 4 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local and 2 more configs: 100.253096ms since last change, 192.268907ms since last push, full=true 2026-09-19T04:26:44.158458Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-19T04:26:44Z/73 2026-09-19T04:26:44.159017Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-19T04:26:44.159020Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-19T04:26:44.159666Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:131 removed:0 size:31.1kB empty:0 cached:131/131 2026-09-19T04:26:44.159749Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:131 removed:0 size:31.1kB empty:0 cached:131/131 2026-09-19T04:26:44.160008Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-19T04:26:44.160068Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:44.160253Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:44.160824Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-19T04:26:44.163350Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:131 2026-09-19T04:26:44.163435Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:131 2026-09-19T04:26:44.969786Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-19T04:26:45.070763Z info ads Push debounce stable[128] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.919129ms since last change, 100.919042ms since last push, full=true 2026-09-19T04:26:45.071312Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-19T04:26:45Z/74 2026-09-19T04:26:45.071883Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-19T04:26:45.071963Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-19T04:26:45.072048Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 2026-09-19T04:26:45.071978Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 2026-09-19T04:26:45.072299Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:45.072385Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:45.072589Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:74.4kB 2026-09-19T04:26:45.073427Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-19T04:26:45.845922Z info ads Push debounce stable[129] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.237425ms since last change, 100.237361ms since last push, full=true 2026-09-19T04:26:45.854486Z info ads XDS: Pushing Services:104 ConnectedEndpoints:2 Version:2026-09-19T04:26:45Z/75 2026-09-19T04:26:45.856508Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:133 removed:0 size:153.9kB cached:132/132 2026-09-19T04:26:45.857993Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:132 removed:0 size:31.2kB empty:0 cached:132/132 2026-09-19T04:26:45.858374Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:26:45.858527Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:26:45.862092Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:136 removed:0 size:154.4kB cached:0/132 2026-09-19T04:26:45.862805Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:132 removed:0 size:31.2kB empty:0 cached:132/132 2026-09-19T04:26:45.863275Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-19T04:26:45.864244Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:36.3kB cached:0/0 2026-09-19T04:26:46.614046Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-19T04:26:47.083179Z info ads Push debounce stable[130] 1 for config ServiceEntry/llm/e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.259503ms since last change, 100.259459ms since last push, full=false 2026-09-19T04:26:47.083263Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:26:45Z/75 2026-09-19T04:26:55.124428Z info ads Push debounce stable[131] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.046299ms since last change, 100.046237ms since last push, full=false 2026-09-19T04:26:55.124503Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:26:45Z/75 2026-09-19T04:26:56.603019Z info model Incremental push, service kserve-controller-manager-metrics-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:26:56.603579Z info model Incremental push, service kserve-controller-manager-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:26:56.703666Z info ads Push debounce stable[132] 2 for config ServiceEntry/opendatahub/kserve-controller-manager-metrics-service.opendatahub.svc.cluster.local and 1 more configs: 100.023513ms since last change, 100.477291ms since last push, full=false 2026-09-19T04:26:56.703736Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:26:45Z/75 2026-09-19T04:27:00.303787Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:27:00.470053Z info ads Push debounce stable[133] 5 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs and 3 more configs: 100.555511ms since last change, 201.619351ms since last push, full=true 2026-09-19T04:27:00.470782Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-19T04:27:00Z/76 2026-09-19T04:27:00.471470Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-19T04:27:00.471549Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-19T04:27:00.472093Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:132 removed:0 size:31.5kB empty:0 cached:132/132 2026-09-19T04:27:00.472224Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:132 removed:0 size:31.5kB empty:0 cached:132/132 2026-09-19T04:27:00.472316Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:27:00.472394Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:27:00.472427Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-19T04:27:00.472547Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:94.5kB 2026-09-19T04:27:00.473363Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-19T04:27:00.473395Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-19T04:27:00.475756Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:132 2026-09-19T04:27:00.476055Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:132 2026-09-19T04:27:01.946065Z info ads Push debounce stable[134] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.224841ms since last change, 100.224797ms since last push, full=true 2026-09-19T04:27:01.955883Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-19T04:27:01Z/77 2026-09-19T04:27:01.956883Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:134 removed:0 size:155.2kB cached:129/133 2026-09-19T04:27:01.957330Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:133 removed:0 size:31.6kB empty:0 cached:133/133 2026-09-19T04:27:01.957536Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:27:01.957611Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:27:01.959758Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:137 removed:0 size:155.7kB cached:0/133 2026-09-19T04:27:01.960294Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:133 removed:0 size:31.6kB empty:0 cached:133/133 2026-09-19T04:27:01.960703Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-19T04:27:01.961605Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-19T04:27:02.044666Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-09-19T04:27:02.145214Z info ads Push debounce stable[135] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.490001ms since last change, 100.489937ms since last push, full=true 2026-09-19T04:27:02.145799Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-19T04:27:02Z/78 2026-09-19T04:27:02.146457Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-19T04:27:02.146556Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-09-19T04:27:02.146457Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-19T04:27:02.146705Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 2026-09-19T04:27:02.146841Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:27:02.146954Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:27:02.147202Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-19T04:27:02.148361Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:45.1kB cached:0/0 2026-09-19T04:27:06.613933Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-09-19T04:27:09.395839Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:27:09.580790Z info ads Push debounce stable[136] 5 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local and 3 more configs: 100.559211ms since last change, 225.631353ms since last push, full=true 2026-09-19T04:27:09.581412Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-19T04:27:09Z/79 2026-09-19T04:27:09.581911Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-19T04:27:09.581971Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-19T04:27:09.582530Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:133 removed:0 size:31.6kB empty:0 cached:133/133 2026-09-19T04:27:09.582651Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:133 removed:0 size:31.6kB empty:0 cached:133/133 2026-09-19T04:27:09.582833Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:27:09.582914Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:27:09.582944Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-19T04:27:09.583050Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-19T04:27:09.584121Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-19T04:27:09.584171Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-19T04:27:09.586199Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:133 2026-09-19T04:27:09.586463Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:133 2026-09-19T04:27:10.507987Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-09-19T04:27:10.608271Z info ads Push debounce stable[137] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.231964ms since last change, 100.231877ms since last push, full=true 2026-09-19T04:27:10.608864Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-19T04:27:10Z/80 2026-09-19T04:27:10.609404Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-09-19T04:27:10.609437Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.8kB cached:0/1 2026-09-19T04:27:10.609471Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-09-19T04:27:10.609501Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 2026-09-19T04:27:10.609765Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:27:10.609859Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:27:10.610014Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:115.1kB 2026-09-19T04:27:10.611034Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-19T04:27:11.200982Z info ads Push debounce stable[138] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.448709ms since last change, 100.448643ms since last push, full=false 2026-09-19T04:27:11.201050Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:10Z/80 2026-09-19T04:27:12.157091Z info ads Push debounce stable[139] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.228864ms since last change, 100.228807ms since last push, full=true 2026-09-19T04:27:12.173776Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-09-19T04:27:12Z/81 2026-09-19T04:27:12.174896Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:135 removed:0 size:156.3kB cached:133/134 2026-09-19T04:27:12.175583Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:134 removed:0 size:31.9kB empty:0 cached:134/134 2026-09-19T04:27:12.175820Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:27:12.175901Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:27:12.178077Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:138 removed:0 size:156.9kB cached:0/134 2026-09-19T04:27:12.178701Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:134 removed:0 size:31.9kB empty:0 cached:134/134 2026-09-19T04:27:12.179055Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-19T04:27:12.180045Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:53.2kB cached:0/0 2026-09-19T04:27:16.614285Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-19T04:27:18.107510Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:27:18.255269Z info ads Push debounce stable[140] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.841139ms since last change, 190.031446ms since last push, full=true 2026-09-19T04:27:18.255985Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-19T04:27:18Z/82 2026-09-19T04:27:18.256666Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-19T04:27:18.256739Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-19T04:27:18.257248Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:134 removed:0 size:31.9kB empty:0 cached:134/134 2026-09-19T04:27:18.257500Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:27:18.257535Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:134 removed:0 size:31.9kB empty:0 cached:134/134 2026-09-19T04:27:18.257583Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:27:18.257623Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-19T04:27:18.257969Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-19T04:27:18.259466Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-19T04:27:18.259501Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-19T04:27:18.260865Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:134 2026-09-19T04:27:18.261727Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 filtered:134 2026-09-19T04:27:19.536421Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-09-19T04:27:19.636712Z info ads Push debounce stable[141] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.240133ms since last change, 100.240057ms since last push, full=true 2026-09-19T04:27:19.637314Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-19T04:27:19Z/83 2026-09-19T04:27:19.637925Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:5 removed:0 size:1.9kB cached:0/1 2026-09-19T04:27:19.637962Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-09-19T04:27:19.638017Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-09-19T04:27:19.638019Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-09-19T04:27:19.638317Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:27:19.638403Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:27:19.638680Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:136.2kB 2026-09-19T04:27:19.639994Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-19T04:27:20.678676Z info ads Push debounce stable[142] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 101.008945ms since last change, 101.008881ms since last push, full=false 2026-09-19T04:27:20.678760Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:19Z/83 2026-09-19T04:27:21.160986Z info ads Push debounce stable[143] 1 for config EnvoyFilter/openshift-ingress/kuadrant-maas-default-gateway: 100.240092ms since last change, 100.24003ms since last push, full=true 2026-09-19T04:27:21.174412Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:27:21.175296Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:136 removed:0 size:157.6kB cached:134/135 2026-09-19T04:27:21.175761Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:135 removed:0 size:32.2kB empty:0 cached:135/135 2026-09-19T04:27:21.175985Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:27:21.176072Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:27:21.178709Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:139 removed:0 size:158.2kB cached:0/135 2026-09-19T04:27:21.179229Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:135 removed:0 size:32.2kB empty:0 cached:135/135 2026-09-19T04:27:21.179602Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-19T04:27:21.180693Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-19T04:27:26.614153Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-09-19T04:27:27.964840Z info ads Push debounce stable[144] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.222778ms since last change, 100.222706ms since last push, full=false 2026-09-19T04:27:27.964905Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:27:28.683435Z info ads Push debounce stable[145] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.21385ms since last change, 100.213759ms since last push, full=false 2026-09-19T04:27:28.683509Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:27:31.162692Z info ads Push debounce stable[146] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.242378ms since last change, 100.242291ms since last push, full=false 2026-09-19T04:27:31.162762Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:27:33.764183Z info ads Push debounce stable[147] 1 for config Secret/llm/e2e-embedding-simulated-kserve-self-signed-certs: 100.244183ms since last change, 100.244123ms since last push, full=false 2026-09-19T04:27:33.764235Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:27:44.666797Z info ads Push debounce stable[148] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.234664ms since last change, 100.234596ms since last push, full=false 2026-09-19T04:27:44.666852Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:27:48.860316Z info ads Push debounce stable[149] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.101692ms since last change, 100.101631ms since last push, full=false 2026-09-19T04:27:48.860390Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:28:04.965007Z info ads Push debounce stable[150] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.229678ms since last change, 100.229632ms since last push, full=false 2026-09-19T04:28:04.965067Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:28:24.650482Z info ads Push debounce stable[151] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.25028ms since last change, 100.250207ms since last push, full=false 2026-09-19T04:28:24.650532Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:28:28.092770Z info ads Push debounce stable[152] 6 for config ServiceEntry/kuadrant-system/authorino-authorino-oidc.kuadrant-system.svc.cluster.local and 2 more configs: 100.439405ms since last change, 127.796135ms since last push, full=false 2026-09-19T04:28:28.092828Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:28:28.362574Z info ads Push debounce stable[153] 5 for config ServiceEntry/kuadrant-system/authorino-authorino-authorization.kuadrant-system.svc.cluster.local and 3 more configs: 100.069625ms since last change, 196.205049ms since last push, full=false 2026-09-19T04:28:28.362628Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:27:21Z/84 2026-09-19T04:28:56.800286Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:28:56.862479Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:28:57.052369Z info ads Push debounce stable[154] 10 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 5 more configs: 100.9883ms since last change, 303.150218ms since last push, full=true 2026-09-19T04:28:57.053006Z info ads XDS: Pushing Services:105 ConnectedEndpoints:2 Version:2026-09-19T04:28:57Z/85 2026-09-19T04:28:57.054571Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:134 removed:2 size:155.4kB cached:128/133 2026-09-19T04:28:57.054612Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:137 removed:2 size:156.0kB cached:128/133 2026-09-19T04:28:57.055254Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:135 removed:0 size:32.1kB empty:2 cached:133/135 2026-09-19T04:28:57.055558Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:135 removed:0 size:32.1kB empty:2 cached:133/135 2026-09-19T04:28:57.055769Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:158.0kB 2026-09-19T04:28:57.055793Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:28:57.055873Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:28:57.055910Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-19T04:28:57.056795Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:60.4kB cached:0/0 2026-09-19T04:28:57.059932Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-19T04:28:57.563849Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:28:57.634921Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-09-19T04:28:57.879741Z info ads Push debounce stable[155] 9 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 5 more configs: 100.218655ms since last change, 330.464733ms since last push, full=true 2026-09-19T04:28:57.881527Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-19T04:28:57Z/86 2026-09-19T04:28:57.883002Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:139 removed:0 size:158.2kB cached:133/135 2026-09-19T04:28:57.883006Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:136 removed:0 size:157.6kB cached:133/135 2026-09-19T04:28:57.883805Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:133 removed:0 size:31.9kB empty:0 cached:133/133 2026-09-19T04:28:57.884130Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:133 removed:0 size:31.9kB empty:0 cached:133/133 2026-09-19T04:28:57.884393Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:28:57.884393Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-19T04:28:57.884570Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:28:57.884672Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-09-19T04:28:57.885935Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-19T04:28:57.885976Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-09-19T04:28:57.896395Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:133 2026-09-19T04:28:57.941448Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:133 2026-09-19T04:29:00.014731Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-09-19T04:29:00.067550Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-09-19T04:29:00.168690Z info ads Push debounce stable[156] 2 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 1 more configs: 101.073845ms since last change, 153.821039ms since last push, full=true 2026-09-19T04:29:00.169243Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-09-19T04:29:00Z/87 2026-09-19T04:29:00.169969Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:6 removed:0 size:2.8kB cached:0/2 2026-09-19T04:29:00.170012Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-09-19T04:29:00.170052Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 2026-09-19T04:29:00.170086Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 2026-09-19T04:29:00.170397Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:7.2kB 2026-09-19T04:29:00.170489Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-6cbcdcfcccj7977.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-09-19T04:29:00.170544Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:158.4kB 2026-09-19T04:29:00.171775Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress resources:1 removed:0 size:61.6kB cached:0/0 2026-09-19T04:29:06.614364Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-c747fcbf8-m7vfh.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|9004||payload-pre-processing.openshift-ingress.svc.cluster.local": {}, "outbound|9004||payload-processing.openshift-ingress.svc.cluster.local": {} } } 2026-09-19T04:29:11.144362Z info ads Push debounce stable[157] 2 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local and 1 more configs: 100.306563ms since last change, 128.372616ms since last push, full=false 2026-09-19T04:29:11.144421Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-09-19T04:29:00Z/87