2026-07-18T01:05:41.789197Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-07-18T01:05:41.789342Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:05:41.789449Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:05:42.317751Z info ads Push debounce stable[74] 2 for config ServiceEntry/kuadrant-system/limitador-limitador.kuadrant-system.svc.cluster.local and 1 more configs: 100.212084ms since last change, 100.214954ms since last push, full=true 2026-07-18T01:05:42.318255Z info ads XDS: Pushing Services:92 ConnectedEndpoints:2 Version:2026-07-18T01:05:42Z/44 2026-07-18T01:05:42.318807Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:2.0kB cached:0/2 2026-07-18T01:05:42.318878Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:3 removed:0 size:1.7kB cached:0/2 2026-07-18T01:05:42.318933Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:2 removed:0 size:436B empty:0 cached:0/2 2026-07-18T01:05:42.318949Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:436B empty:0 cached:2/2 2026-07-18T01:05:42.319183Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-18T01:05:42.319207Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-18T01:05:42.319227Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-07-18T01:05:42.319299Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:05:42.319401Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:05:46.411702Z info ads Push debounce stable[75] 7 for config ConfigMap/odh-ai-gateway-infra/kube-root-ca.crt and 3 more configs: 100.034552ms since last change, 136.15053ms since last push, full=false 2026-07-18T01:05:46.411768Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:05:42Z/44 2026-07-18T01:05:46.733862Z info model Incremental push, service postgres.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:05:46.834316Z info ads Push debounce stable[76] 3 for config Secret/odh-ai-gateway-infra/postgres-creds and 1 more configs: 100.377518ms since last change, 146.495127ms since last push, full=true 2026-07-18T01:05:46.834810Z info ads XDS: Pushing Services:93 ConnectedEndpoints:2 Version:2026-07-18T01:05:46Z/45 2026-07-18T01:05:46.835414Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:3 removed:0 size:1.6kB cached:0/1 2026-07-18T01:05:46.835413Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-07-18T01:05:46.835713Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-18T01:05:46.835742Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-18T01:05:46.835769Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-07-18T01:05:46.835812Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:05:46.835847Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:05:46.835949Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:05:46.836032Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:05:46.841018Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:64B empty:1 cached:0/1 filtered:120 2026-07-18T01:05:46.841071Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:64B empty:0 cached:1/1 filtered:120 2026-07-18T01:05:46.972077Z info ads Push debounce stable[77] 1 for config Secret/odh-ai-gateway-infra/maas-db-config: 100.14576ms since last change, 100.145685ms since last push, full=false 2026-07-18T01:05:46.972142Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:05:46Z/45 2026-07-18T01:05:51.070724Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|5432||postgres.odh-ai-gateway-infra.svc.cluster.local": {} } } 2026-07-18T01:05:53.195526Z info model Full push, new service odh-ai-gateway-infra/postgres.odh-ai-gateway-infra.svc.cluster.local 2026-07-18T01:05:53.295816Z info ads Push debounce stable[78] 1 for config ServiceEntry/odh-ai-gateway-infra/postgres.odh-ai-gateway-infra.svc.cluster.local: 100.232329ms since last change, 100.232252ms since last push, full=true 2026-07-18T01:05:53.296397Z info ads XDS: Pushing Services:93 ConnectedEndpoints:2 Version:2026-07-18T01:05:53Z/46 2026-07-18T01:05:53.296899Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:3 removed:0 size:1.7kB cached:0/1 2026-07-18T01:05:53.296972Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:64B empty:1 cached:0/1 2026-07-18T01:05:53.297039Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-07-18T01:05:53.297105Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:64B empty:0 cached:1/1 2026-07-18T01:05:53.297198Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-18T01:05:53.297274Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-18T01:05:53.297345Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:05:53.297345Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-07-18T01:05:53.297432Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:05:59.332251Z info ads Push debounce stable[79] 1 for config ServiceEntry/odh-ai-gateway-infra/postgres.odh-ai-gateway-infra.svc.cluster.local: 100.409663ms since last change, 100.409602ms since last push, full=false 2026-07-18T01:05:59.332332Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:05:53Z/46 2026-07-18T01:05:59.911113Z info ads Push debounce stable[80] 1 for config Secret/kuadrant-system/authorino-server-cert: 100.260309ms since last change, 100.260239ms since last push, full=false 2026-07-18T01:05:59.911180Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:05:53Z/46 2026-07-18T01:06:01.070729Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|5432||postgres.odh-ai-gateway-infra.svc.cluster.local": {} } } 2026-07-18T01:06:01.359832Z info ads Push debounce stable[81] 6 for config ServiceEntry/kuadrant-system/authorino-authorino-oidc.kuadrant-system.svc.cluster.local and 2 more configs: 100.780319ms since last change, 126.831149ms since last push, full=false 2026-07-18T01:06:01.359893Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:05:53Z/46 2026-07-18T01:06:01.630407Z info ads Push debounce stable[82] 3 for config ServiceEntry/kuadrant-system/authorino-authorino-oidc.kuadrant-system.svc.cluster.local and 2 more configs: 100.303579ms since last change, 100.30864ms since last push, full=false 2026-07-18T01:06:01.630473Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:05:53Z/46 2026-07-18T01:06:03.885312Z info ads Push debounce stable[83] 3 for config ServiceEntry/kuadrant-system/authorino-authorino-oidc.kuadrant-system.svc.cluster.local and 2 more configs: 100.157668ms since last change, 103.098203ms since last push, full=false 2026-07-18T01:06:03.885378Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:05:53Z/46 2026-07-18T01:06:04.154417Z info ads Push debounce stable[84] 3 for config ServiceEntry/kuadrant-system/authorino-authorino-oidc.kuadrant-system.svc.cluster.local and 2 more configs: 100.030783ms since last change, 100.90082ms since last push, full=false 2026-07-18T01:06:04.154478Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:05:53Z/46 2026-07-18T01:06:05.735787Z info model Incremental push, service maas-controller-webhook-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:06:05.836499Z info ads Push debounce stable[85] 4 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local and 1 more configs: 100.655514ms since last change, 219.099174ms since last push, full=true 2026-07-18T01:06:05.837033Z info ads XDS: Pushing Services:94 ConnectedEndpoints:2 Version:2026-07-18T01:06:05Z/47 2026-07-18T01:06:05.837542Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-07-18T01:06:05.837554Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:3 removed:0 size:1.5kB cached:0/1 2026-07-18T01:06:05.837792Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-18T01:06:05.837818Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-18T01:06:05.837868Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-07-18T01:06:05.837797Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:06:05.837908Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:06:05.837984Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:06:05.838020Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:06:05.841079Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:77B empty:1 cached:0/1 filtered:121 2026-07-18T01:06:05.841390Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:77B empty:0 cached:1/1 filtered:121 2026-07-18T01:06:05.959417Z info ads Push debounce stable[86] 1 for config Secret/opendatahub/maas-controller-webhook-cert: 100.423708ms since last change, 100.423653ms since last push, full=false 2026-07-18T01:06:05.959474Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:06:05Z/47 2026-07-18T01:06:09.292756Z info model Full push, new service opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local 2026-07-18T01:06:09.410854Z info ads Push debounce stable[87] 8 for config Secret/ai-tenants/deployer-dockercfg-nd2rb and 4 more configs: 100.372554ms since last change, 140.566129ms since last push, full=true 2026-07-18T01:06:09.411404Z info ads XDS: Pushing Services:94 ConnectedEndpoints:2 Version:2026-07-18T01:06:09Z/48 2026-07-18T01:06:09.412648Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:123 removed:0 size:142.3kB cached:114/122 2026-07-18T01:06:09.412708Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:124 removed:0 size:142.6kB cached:114/122 2026-07-18T01:06:09.413272Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:122 removed:0 size:29.1kB empty:1 cached:121/122 2026-07-18T01:06:09.413397Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:122 removed:0 size:29.1kB empty:0 cached:122/122 2026-07-18T01:06:09.413573Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:06:09.413682Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-18T01:06:09.413755Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-18T01:06:09.413807Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-07-18T01:06:09.413719Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:06:09.413914Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:06:09.413873Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:06:11.071431Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|443||maas-controller-webhook-service.opendatahub.svc.cluster.local": {} } } 2026-07-18T01:06:20.429886Z info ads Push debounce stable[88] 3 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local: 100.469293ms since last change, 140.90743ms since last push, full=false 2026-07-18T01:06:20.429958Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:06:09Z/48 2026-07-18T01:06:20.690326Z info ads Push debounce stable[89] 1 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local: 100.312629ms since last change, 100.312568ms since last push, full=false 2026-07-18T01:06:20.690387Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:06:09Z/48 2026-07-18T01:06:39.394108Z info ads Push debounce stable[90] 7 for config Secret/models-as-a-service/builder-dockercfg-fvtp2 and 3 more configs: 100.886066ms since last change, 145.741854ms since last push, full=false 2026-07-18T01:06:39.394181Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:06:09Z/48 2026-07-18T01:06:39.838021Z info model Incremental push, service maas-api.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:06:40.043900Z info ads Push debounce stable[91] 6 for config Secret/odh-ai-gateway-infra/maas-api-cleanup-dockercfg-qcj7c and 2 more configs: 100.466141ms since last change, 212.511366ms since last push, full=true 2026-07-18T01:06:40.044432Z info ads XDS: Pushing Services:95 ConnectedEndpoints:2 Version:2026-07-18T01:06:40Z/49 2026-07-18T01:06:40.044979Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:3 removed:0 size:1.4kB cached:0/1 2026-07-18T01:06:40.045084Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-07-18T01:06:40.045249Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.9kB 2026-07-18T01:06:40.045374Z warn constructed http route config for route https.443.default.maas-default-gateway-istio-autogenerated-k8s-gateway-https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-07-18T01:06:40.045440Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-07-18T01:06:40.045387Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:06:40.045501Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:06:40.045631Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:06:40.045674Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:06:40.048601Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:64B empty:1 cached:0/1 filtered:122 2026-07-18T01:06:40.048868Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:64B empty:0 cached:1/1 filtered:122 2026-07-18T01:06:40.334435Z info model Incremental push, service payload-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:06:40.395236Z info model Incremental push, service payload-pre-processing.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:06:40.587262Z info ads Push debounce stable[92] 14 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 10 more configs: 101.001363ms since last change, 427.617276ms since last push, full=true 2026-07-18T01:06:40.589167Z info ads XDS: Pushing Services:97 ConnectedEndpoints:2 Version:2026-07-18T01:06:40Z/50 2026-07-18T01:06:40.590517Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:126 removed:0 size:145.5kB cached:121/125 2026-07-18T01:06:40.591106Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:123 removed:0 size:29.3kB empty:1 cached:122/123 2026-07-18T01:06:40.591428Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:06:40.591520Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:06:40.591624Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:06:40.593731Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:127 removed:0 size:145.8kB cached:0/125 2026-07-18T01:06:40.594316Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:123 removed:0 size:29.3kB empty:0 cached:123/123 2026-07-18T01:06:40.594557Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:06:40.594823Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.6kB cached:0/0 2026-07-18T01:06:40.594867Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:06:40.602865Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:146B empty:2 cached:0/2 filtered:123 2026-07-18T01:06:40.605907Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:2 removed:0 size:146B empty:0 cached:2/2 filtered:123 2026-07-18T01:06:40.617657Z info delta ECDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.5kB filtered:0 2026-07-18T01:06:40.786071Z info ads Push debounce stable[93] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-maas-default-gateway: 100.160696ms since last change, 100.160627ms since last push, full=true 2026-07-18T01:06:40.786606Z info ads XDS: Pushing Services:97 ConnectedEndpoints:2 Version:2026-07-18T01:06:40Z/51 2026-07-18T01:06:40.787359Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:126 removed:0 size:145.5kB cached:125/125 2026-07-18T01:06:40.787844Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:125 removed:0 size:29.5kB empty:0 cached:125/125 2026-07-18T01:06:40.788101Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:06:40.788197Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:06:40.790754Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:128 removed:0 size:145.9kB cached:0/125 2026-07-18T01:06:40.791252Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:125 removed:0 size:29.5kB empty:0 cached:125/125 2026-07-18T01:06:40.791535Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:06:40.791735Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.6kB cached:0/0 2026-07-18T01:06:40.792005Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.5kB 2026-07-18T01:06:40.889013Z info ads Push debounce stable[94] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.436083ms since last change, 100.435945ms since last push, full=true 2026-07-18T01:06:40.890501Z info ads XDS: Pushing Services:97 ConnectedEndpoints:2 Version:2026-07-18T01:06:40Z/52 2026-07-18T01:06:40.890928Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:06:40.890929Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:06:40.891910Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:8.8kB 2026-07-18T01:06:43.463832Z info model Full push, new service odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local 2026-07-18T01:06:43.475492Z info model Full push, new service openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local 2026-07-18T01:06:43.575609Z info ads Push debounce stable[95] 2 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local and 1 more configs: 100.056802ms since last change, 111.71926ms since last push, full=true 2026-07-18T01:06:43.576184Z info ads XDS: Pushing Services:97 ConnectedEndpoints:2 Version:2026-07-18T01:06:43Z/53 2026-07-18T01:06:43.576862Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:3 removed:0 size:2.2kB cached:0/2 2026-07-18T01:06:43.576903Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:5 removed:0 size:2.6kB cached:0/2 2026-07-18T01:06:43.576946Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:139B empty:2 cached:0/2 2026-07-18T01:06:43.576958Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:2 removed:0 size:139B empty:0 cached:2/2 2026-07-18T01:06:43.577214Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:06:43.577275Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:06:43.577368Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:06:43.577481Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.6kB cached:0/0 2026-07-18T01:06:43.600677Z info model Full push, new service openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local 2026-07-18T01:06:43.701012Z info ads Push debounce stable[96] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.274323ms since last change, 100.274222ms since last push, full=true 2026-07-18T01:06:43.701830Z info ads XDS: Pushing Services:97 ConnectedEndpoints:2 Version:2026-07-18T01:06:43Z/54 2026-07-18T01:06:43.703493Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.6kB cached:0/1 2026-07-18T01:06:43.703628Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:71B empty:1 cached:0/1 2026-07-18T01:06:43.703941Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:06:43.704239Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.6kB cached:0/0 2026-07-18T01:06:43.704722Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.1kB cached:0/1 2026-07-18T01:06:43.704977Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:71B empty:0 cached:1/1 2026-07-18T01:06:43.705335Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:06:43.705567Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:06:47.931392Z info delta ADS: "10.133.0.35:52192" maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress-2 terminated 2026-07-18T01:06:48.639543Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-07-18T01:06:48.639575Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-07-18T01:06:48.677326Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-07-18T01:06:48.726317Z info ads Push debounce stable[97] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.803548ms since last change, 100.803486ms since last push, full=false 2026-07-18T01:06:48.726376Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-07-18T01:06:43Z/54 2026-07-18T01:06:48.763054Z info delta ADS: new delta connection for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress-3 2026-07-18T01:06:48.763812Z info delta CDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:128 removed:0 size:145.9kB cached:123/125 2026-07-18T01:06:48.834882Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:125 removed:0 size:29.1kB empty:0 cached:125/125 filtered:0 2026-07-18T01:06:49.036916Z info delta LDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:06:49.042969Z info delta ECDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:8.8kB filtered:0 2026-07-18T01:06:49.043220Z info delta RDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.6kB cached:0/0 filtered:0 2026-07-18T01:06:49.043309Z info delta SDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0 2026-07-18T01:06:49.580938Z info ads Push debounce stable[98] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api.odh-ai-gateway-infra.svc.cluster.local: 100.369822ms since last change, 100.369747ms since last push, full=false 2026-07-18T01:06:49.580991Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:06:43Z/54 2026-07-18T01:06:50.523360Z info ads Push debounce stable[99] 7 for config ConfigMap/llm/kube-root-ca.crt and 3 more configs: 100.211527ms since last change, 143.73217ms since last push, full=false 2026-07-18T01:06:50.523447Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:06:43Z/54 2026-07-18T01:06:51.070811Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|15021||maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local": {}, "outbound|443||maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local": {}, "outbound|9004||payload-processing.openshift-ingress.svc.cluster.local": {} } } 2026-07-18T01:06:51.993297Z info ads Push debounce stable[100] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.566054ms since last change, 100.565956ms since last push, full=true 2026-07-18T01:06:51.995696Z info ads XDS: Pushing Services:97 ConnectedEndpoints:2 Version:2026-07-18T01:06:51Z/55 2026-07-18T01:06:51.996113Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:06:51.996153Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:06:51.997005Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:8.0kB 2026-07-18T01:06:54.130879Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:128 removed:0 size:145.9kB cached:122/125 2026-07-18T01:06:54.131500Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:125 removed:0 size:29.2kB empty:0 cached:125/125 2026-07-18T01:06:54.131755Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:06:54.131999Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:3.6kB cached:0/0 2026-07-18T01:06:54.132038Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:06:54.132903Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:8.0kB 2026-07-18T01:06:54.150663Z info gateway reconciling gateway with controller openshift.io/gateway-controller/v1 gateway=openshift-ingress/maas-default-gateway 2026-07-18T01:06:54.150691Z info gateway reconciling gateway=openshift-ingress/maas-default-gateway 2026-07-18T01:06:54.185956Z info gateway gateway updated gateway=openshift-ingress/maas-default-gateway 2026-07-18T01:06:54.238914Z info ads Push debounce stable[101] 1 for config ServiceEntry/openshift-ingress/maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local: 100.901505ms since last change, 100.901436ms since last push, full=false 2026-07-18T01:06:54.238966Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:06:51Z/55 2026-07-18T01:06:54.571006Z info ads Push debounce stable[102] 1 for config ServiceEntry/openshift-ingress/payload-pre-processing.openshift-ingress.svc.cluster.local: 100.494261ms since last change, 100.494184ms since last push, full=false 2026-07-18T01:06:54.571075Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:06:51Z/55 2026-07-18T01:06:54.708169Z info ads Push debounce stable[103] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.918448ms since last change, 100.918383ms since last push, full=false 2026-07-18T01:06:54.708222Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:06:51Z/55 2026-07-18T01:07:01.071145Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-07-18T01:07:01.885397Z info ads Push debounce stable[104] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 101.002183ms since last change, 101.002119ms since last push, full=false 2026-07-18T01:07:01.885461Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:06:51Z/55 2026-07-18T01:07:02.099908Z info model Incremental push, service e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:07:02.220764Z info ads Push debounce stable[105] 3 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 101.072861ms since last change, 126.178687ms since last push, full=true 2026-07-18T01:07:02.221340Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-07-18T01:07:02Z/56 2026-07-18T01:07:02.221955Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-07-18T01:07:02.221988Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-18T01:07:02.222256Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:02.222462Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:02.222635Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:07:02.222729Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:11.6kB cached:0/0 2026-07-18T01:07:02.227123Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 filtered:125 2026-07-18T01:07:02.227242Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 filtered:125 2026-07-18T01:07:02.582180Z info ads Push debounce stable[106] 1 for config DestinationRule/llm/e2e-distinct-2-simulated-kserve-workload-svc: 100.210173ms since last change, 100.210089ms since last push, full=true 2026-07-18T01:07:02.582365Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-07-18T01:07:02Z/57 2026-07-18T01:07:02.582863Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-07-18T01:07:02.582888Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-07-18T01:07:02.583496Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:126 removed:0 size:30.0kB empty:1 cached:125/126 2026-07-18T01:07:02.583713Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:126 removed:0 size:30.0kB empty:0 cached:126/126 2026-07-18T01:07:02.583788Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:02.584040Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:02.584215Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:07:02.584350Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:11.6kB cached:0/0 2026-07-18T01:07:02.900986Z info ads Push debounce stable[107] 3 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway and 1 more configs: 100.402729ms since last change, 197.251394ms since last push, full=true 2026-07-18T01:07:02.904435Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-07-18T01:07:02Z/58 2026-07-18T01:07:02.904830Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:02.904934Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:07:02.904851Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:02.905241Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:07:02.907425Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:28.9kB 2026-07-18T01:07:03.704097Z info model Full push, new service llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-07-18T01:07:03.804564Z info ads Push debounce stable[108] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.421787ms since last change, 100.421717ms since last push, full=true 2026-07-18T01:07:03.805084Z info ads XDS: Pushing Services:98 ConnectedEndpoints:2 Version:2026-07-18T01:07:03Z/59 2026-07-18T01:07:03.805642Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-07-18T01:07:03.805706Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:83B empty:1 cached:0/1 2026-07-18T01:07:03.805646Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-07-18T01:07:03.805881Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:83B empty:0 cached:1/1 2026-07-18T01:07:03.805946Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:03.806128Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:03.806232Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:07:03.806434Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:11.6kB cached:0/0 2026-07-18T01:07:11.071742Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-07-18T01:07:12.860560Z info ads Push debounce stable[109] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.81148ms since last change, 100.811428ms since last push, full=false 2026-07-18T01:07:12.860630Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:07:03Z/59 2026-07-18T01:07:27.039002Z info model Incremental push, service e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:07:27.190569Z info ads Push debounce stable[110] 5 for config DestinationRule/llm/e2e-distinct-simulated-kserve-workload-svc and 3 more configs: 100.581104ms since last change, 198.52297ms since last push, full=true 2026-07-18T01:07:27.191152Z info ads XDS: Pushing Services:99 ConnectedEndpoints:2 Version:2026-07-18T01:07:27Z/60 2026-07-18T01:07:27.191691Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-07-18T01:07:27.191694Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-07-18T01:07:27.192373Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:126 removed:0 size:30.2kB empty:0 cached:126/126 2026-07-18T01:07:27.192532Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:126 removed:0 size:30.2kB empty:0 cached:126/126 2026-07-18T01:07:27.192756Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:27.192806Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:27.192921Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:07:27.192987Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:07:27.193507Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:19.5kB cached:0/0 2026-07-18T01:07:27.193553Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:07:27.196779Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 filtered:126 2026-07-18T01:07:27.197440Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 filtered:126 2026-07-18T01:07:28.211675Z info ads Push debounce stable[111] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.214715ms since last change, 100.214653ms since last push, full=true 2026-07-18T01:07:28.215230Z info ads XDS: Pushing Services:99 ConnectedEndpoints:2 Version:2026-07-18T01:07:28Z/61 2026-07-18T01:07:28.215550Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:28.215552Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:28.218652Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:49.6kB 2026-07-18T01:07:29.680500Z info model Full push, new service llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-07-18T01:07:29.780893Z info ads Push debounce stable[112] 1 for config ServiceEntry/llm/e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.268957ms since last change, 100.268896ms since last push, full=true 2026-07-18T01:07:29.781446Z info ads XDS: Pushing Services:99 ConnectedEndpoints:2 Version:2026-07-18T01:07:29Z/62 2026-07-18T01:07:29.782050Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-07-18T01:07:29.782106Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-07-18T01:07:29.782124Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:81B empty:1 cached:0/1 2026-07-18T01:07:29.782166Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:81B empty:0 cached:1/1 2026-07-18T01:07:29.782402Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:29.782417Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:29.782511Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:07:29.782903Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:19.5kB cached:0/0 2026-07-18T01:07:31.070850Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-07-18T01:07:36.226929Z info model Incremental push, service e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:07:36.394536Z info ads Push debounce stable[113] 5 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 3 more configs: 100.042197ms since last change, 200.322495ms since last push, full=true 2026-07-18T01:07:36.395118Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-07-18T01:07:36Z/63 2026-07-18T01:07:36.395673Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-07-18T01:07:36.395676Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-07-18T01:07:36.396341Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:127 removed:0 size:30.3kB empty:0 cached:127/127 2026-07-18T01:07:36.396546Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:127 removed:0 size:30.3kB empty:0 cached:127/127 2026-07-18T01:07:36.396620Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:36.396720Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:07:36.396804Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:07:36.396807Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:36.397741Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:27.5kB cached:0/0 2026-07-18T01:07:36.397789Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:07:36.400073Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:82B empty:1 cached:0/1 filtered:127 2026-07-18T01:07:36.400372Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:82B empty:0 cached:1/1 filtered:127 2026-07-18T01:07:37.722671Z info model Full push, new service llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-07-18T01:07:37.844242Z info ads Push debounce stable[114] 2 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.553742ms since last change, 121.511431ms since last push, full=true 2026-07-18T01:07:37.844810Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-07-18T01:07:37Z/64 2026-07-18T01:07:37.845419Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:5 removed:0 size:2.8kB cached:0/2 2026-07-18T01:07:37.845522Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:2 removed:0 size:322B empty:1 cached:0/2 2026-07-18T01:07:37.845526Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:3 removed:0 size:2.4kB cached:0/2 2026-07-18T01:07:37.845616Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:322B empty:0 cached:2/2 2026-07-18T01:07:37.845816Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:37.845882Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:37.845990Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:07:37.846473Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:27.5kB cached:0/0 2026-07-18T01:07:38.114667Z info ads Push debounce stable[115] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.215218ms since last change, 100.215158ms since last push, full=true 2026-07-18T01:07:38.119727Z info ads XDS: Pushing Services:100 ConnectedEndpoints:2 Version:2026-07-18T01:07:38Z/65 2026-07-18T01:07:38.120058Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:38.120068Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:38.123616Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:70.4kB 2026-07-18T01:07:46.878113Z info ads Push debounce stable[116] 1 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.073667ms since last change, 100.073598ms since last push, full=false 2026-07-18T01:07:46.878174Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:07:38Z/65 2026-07-18T01:07:47.646261Z info model Incremental push, service e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:07:47.784862Z info ads Push debounce stable[117] 5 for config DestinationRule/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc and 3 more configs: 100.233565ms since last change, 196.747615ms since last push, full=true 2026-07-18T01:07:47.785475Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-07-18T01:07:47Z/66 2026-07-18T01:07:47.786006Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-07-18T01:07:47.786018Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-18T01:07:47.786683Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:128 removed:0 size:30.7kB empty:0 cached:128/128 2026-07-18T01:07:47.786748Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:128 removed:0 size:30.7kB empty:0 cached:128/128 2026-07-18T01:07:47.786935Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:47.786979Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:47.787082Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:07:47.787231Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:07:47.787847Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:36.2kB cached:0/0 2026-07-18T01:07:47.787893Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:07:47.790900Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 filtered:128 2026-07-18T01:07:47.790903Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:102B empty:0 cached:1/1 filtered:128 2026-07-18T01:07:48.775241Z info model Full push, new service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 2026-07-18T01:07:48.875556Z info ads Push debounce stable[118] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.225234ms since last change, 100.225179ms since last push, full=true 2026-07-18T01:07:48.876083Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-07-18T01:07:48Z/67 2026-07-18T01:07:48.876644Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-07-18T01:07:48.876655Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-18T01:07:48.876714Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-07-18T01:07:48.876731Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:102B empty:1 cached:0/1 2026-07-18T01:07:48.876953Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:48.876968Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:48.877065Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:07:48.877844Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:36.2kB cached:0/0 2026-07-18T01:07:50.033960Z info ads Push debounce stable[119] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.104052ms since last change, 100.103983ms since last push, full=true 2026-07-18T01:07:50.040356Z info ads XDS: Pushing Services:101 ConnectedEndpoints:2 Version:2026-07-18T01:07:50Z/68 2026-07-18T01:07:50.040699Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:07:50.040702Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:07:50.047018Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:91.7kB 2026-07-18T01:07:58.960147Z info ads Push debounce stable[120] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.771171ms since last change, 100.771108ms since last push, full=false 2026-07-18T01:07:58.960222Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:07:50Z/68 2026-07-18T01:08:03.088426Z info model Incremental push, service facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:08:03.215983Z info ads Push debounce stable[121] 5 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs and 3 more configs: 100.544062ms since last change, 224.940134ms since last push, full=true 2026-07-18T01:08:03.216646Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-07-18T01:08:03Z/69 2026-07-18T01:08:03.217107Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-07-18T01:08:03.217189Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-07-18T01:08:03.217731Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:129 removed:0 size:31.0kB empty:0 cached:129/129 2026-07-18T01:08:03.217908Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:129 removed:0 size:31.0kB empty:0 cached:129/129 2026-07-18T01:08:03.218014Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:08:03.218108Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:08:03.218153Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:08:03.218236Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:08:03.219258Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:44.3kB cached:0/0 2026-07-18T01:08:03.219318Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:08:03.221478Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:129 2026-07-18T01:08:03.221631Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:129 2026-07-18T01:08:03.998120Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-07-18T01:08:04.098399Z info ads Push debounce stable[122] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.220308ms since last change, 100.220223ms since last push, full=true 2026-07-18T01:08:04.098935Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-07-18T01:08:04Z/70 2026-07-18T01:08:04.099507Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-07-18T01:08:04.099574Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 2026-07-18T01:08:04.099583Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-07-18T01:08:04.099653Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 2026-07-18T01:08:04.099846Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:08:04.099908Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:08:04.099999Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:08:04.100983Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:44.3kB cached:0/0 2026-07-18T01:08:06.431094Z info ads Push debounce stable[123] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.254729ms since last change, 100.254661ms since last push, full=true 2026-07-18T01:08:06.438758Z info ads XDS: Pushing Services:102 ConnectedEndpoints:2 Version:2026-07-18T01:08:06Z/71 2026-07-18T01:08:06.439084Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:08:06.439086Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:08:06.444756Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:113.1kB 2026-07-18T01:08:08.691177Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-07-18T01:08:08.818323Z info ads Push debounce stable[124] 5 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs and 3 more configs: 100.512673ms since last change, 222.338185ms since last push, full=true 2026-07-18T01:08:08.818924Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-07-18T01:08:08Z/72 2026-07-18T01:08:08.819500Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-07-18T01:08:08.819526Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-18T01:08:08.820133Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:130 removed:0 size:31.1kB empty:0 cached:130/130 2026-07-18T01:08:08.820310Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:130 removed:0 size:31.1kB empty:0 cached:130/130 2026-07-18T01:08:08.820396Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:08:08.820498Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:08:08.820566Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-07-18T01:08:08.820595Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:08:08.821616Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0 2026-07-18T01:08:08.821652Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-07-18T01:08:08.824799Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:130 2026-07-18T01:08:08.824803Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:130 2026-07-18T01:08:10.397881Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-07-18T01:08:10.498048Z info ads Push debounce stable[125] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.021573ms since last change, 100.021498ms since last push, full=true 2026-07-18T01:08:10.498661Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-07-18T01:08:10Z/73 2026-07-18T01:08:10.499243Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-07-18T01:08:10.499354Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-07-18T01:08:10.499371Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-07-18T01:08:10.499459Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-07-18T01:08:10.499652Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:08:10.499671Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:08:10.499755Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-07-18T01:08:10.500835Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0 2026-07-18T01:08:11.071257Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-07-18T01:08:12.766859Z info ads Push debounce stable[126] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.221757ms since last change, 100.221706ms since last push, full=true 2026-07-18T01:08:12.775746Z info ads XDS: Pushing Services:103 ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:12.776075Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:4.5kB 2026-07-18T01:08:12.776075Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678hl5nv.openshift-ingress resources:1 removed:0 size:7.2kB 2026-07-18T01:08:12.782830Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-ksdmk.openshift-ingress resources:1 removed:0 size:135.6kB 2026-07-18T01:08:14.150910Z info ads Push debounce stable[127] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.476225ms since last change, 100.476173ms since last push, full=false 2026-07-18T01:08:14.150980Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:19.091994Z info ads Push debounce stable[128] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.543286ms since last change, 100.543218ms since last push, full=false 2026-07-18T01:08:19.092048Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:19.554517Z info ads Push debounce stable[129] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.172848ms since last change, 100.172787ms since last push, full=false 2026-07-18T01:08:19.554582Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:27.297131Z info ads Push debounce stable[130] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.221048ms since last change, 100.220974ms since last push, full=false 2026-07-18T01:08:27.297205Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:29.899374Z info ads Push debounce stable[131] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.520699ms since last change, 100.520638ms since last push, full=false 2026-07-18T01:08:29.899446Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:35.994595Z info ads Push debounce stable[132] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.228715ms since last change, 100.228649ms since last push, full=false 2026-07-18T01:08:35.994651Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:41.688207Z info ads Push debounce stable[133] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.21053ms since last change, 100.210478ms since last push, full=false 2026-07-18T01:08:41.688273Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:45.491318Z info ads Push debounce stable[134] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.215499ms since last change, 100.215424ms since last push, full=false 2026-07-18T01:08:45.491374Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:48.723639Z info ads Push debounce stable[135] 6 for config ServiceEntry/kuadrant-system/authorino-authorino-oidc.kuadrant-system.svc.cluster.local and 2 more configs: 100.753186ms since last change, 135.369377ms since last push, full=false 2026-07-18T01:08:48.723706Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:48.997976Z info ads Push debounce stable[136] 3 for config ServiceEntry/kuadrant-system/authorino-authorino-authorization.kuadrant-system.svc.cluster.local and 2 more configs: 100.261939ms since last change, 103.286167ms since last push, full=false 2026-07-18T01:08:48.998046Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:49.250691Z info ads Push debounce stable[137] 7 for config Secret/premium-users-namespace/deployer-dockercfg-ctjt4 and 3 more configs: 100.339288ms since last change, 168.654583ms since last push, full=false 2026-07-18T01:08:49.250755Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:49.415942Z info ads Push debounce stable[138] 2 for config Secret/premium-users-namespace/premium-service-account-dockercfg-4z9h8: 100.253701ms since last change, 118.954244ms since last push, full=false 2026-07-18T01:08:49.416014Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:50.315104Z info ads Push debounce stable[139] 7 for config Secret/maas-admin/default-dockercfg-xjck9 and 3 more configs: 100.210913ms since last change, 129.835334ms since last push, full=false 2026-07-18T01:08:50.315168Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:50.553978Z info ads Push debounce stable[140] 2 for config Secret/maas-admin/tester-admin-user-dockercfg-xnvzk: 100.156361ms since last change, 132.209606ms since last push, full=false 2026-07-18T01:08:50.554023Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74 2026-07-18T01:08:51.906537Z info ads Push debounce stable[141] 2 for config Secret/default/tester-regular-user-dockercfg-469t2: 100.715356ms since last change, 111.692213ms since last push, full=false 2026-07-18T01:08:51.906611Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-18T01:08:12Z/74