2026-06-09T15:29:49.045230Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:29:49.045281Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:29:49.045305Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-09T15:29:49.045608Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:16.4kB cached:0/0 2026-06-09T15:29:49.049131Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:86B empty:1 cached:0/1 filtered:134 2026-06-09T15:29:49.049300Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:86B empty:0 cached:1/1 filtered:134 2026-06-09T15:29:49.517797Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } }, "pilot_eds_no_instances": { "outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local": {} } } 2026-06-09T15:29:49.729228Z info model Full push, new service llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 2026-06-09T15:29:49.845832Z info ads Push debounce stable[121] 2 for config ServiceEntry/llm/e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local and 1 more configs: 100.050551ms since last change, 116.513102ms since last push, full=true 2026-06-09T15:29:49.846789Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-06-09T15:29:49Z/72 2026-06-09T15:29:49.848274Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:3 removed:0 size:2.4kB cached:0/2 2026-06-09T15:29:49.848328Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:5 removed:0 size:2.9kB cached:0/2 2026-06-09T15:29:49.848416Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:2 removed:0 size:329B empty:1 cached:0/2 2026-06-09T15:29:49.848455Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:2 removed:0 size:329B empty:0 cached:2/2 2026-06-09T15:29:49.848728Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:29:49.848761Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:29:49.848892Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-09T15:29:49.849225Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:16.4kB cached:0/0 2026-06-09T15:29:50.160172Z info ads Push debounce stable[122] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.915383ms since last change, 100.915331ms since last push, full=true 2026-06-09T15:29:50.164117Z info ads XDS: Pushing Services:106 ConnectedEndpoints:2 Version:2026-06-09T15:29:50Z/73 2026-06-09T15:29:50.164445Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:29:50.164447Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:29:50.167048Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:36.8kB 2026-06-09T15:29:55.637557Z info ads Push debounce stable[123] 1 for config ServiceEntry/llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local: 100.500241ms since last change, 100.500164ms since last push, full=false 2026-06-09T15:29:55.637617Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:29:50Z/73 2026-06-09T15:30:05.246883Z info model Incremental push, service premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-06-09T15:30:05.347510Z info ads Push debounce stable[124] 3 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs and 1 more configs: 100.571243ms since last change, 155.533606ms since last push, full=true 2026-06-09T15:30:05.348124Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:30:05Z/74 2026-06-09T15:30:05.348662Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:4 removed:0 size:1.9kB cached:0/1 2026-06-09T15:30:05.348662Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-06-09T15:30:05.348936Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:30:05.349055Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:30:05.349141Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-09T15:30:05.349183Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-06-09T15:30:05.349299Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:16.4kB cached:0/0 2026-06-09T15:30:05.349331Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-06-09T15:30:05.354022Z info delta EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 filtered:135 2026-06-09T15:30:05.354385Z info delta EDS: PUSH request for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 filtered:135 2026-06-09T15:30:05.503407Z info ads Push debounce stable[125] 2 for config DestinationRule/llm/premium-simulated-simulated-premium-kserve-workload-svc and 1 more configs: 100.914668ms since last change, 115.807015ms since last push, full=true 2026-06-09T15:30:05.503595Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:30:05Z/75 2026-06-09T15:30:05.504121Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-06-09T15:30:05.504120Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-06-09T15:30:05.504733Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:136 removed:0 size:32.2kB empty:1 cached:134/136 2026-06-09T15:30:05.504929Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:136 removed:0 size:32.2kB empty:1 cached:134/136 2026-06-09T15:30:05.504959Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:30:05.505142Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:30:05.505213Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-09T15:30:05.505340Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:19.4kB cached:0/0 2026-06-09T15:30:06.574677Z info model Full push, new service llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 2026-06-09T15:30:06.674959Z info ads Push debounce stable[126] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.230674ms since last change, 100.230598ms since last push, full=true 2026-06-09T15:30:06.675535Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/76 2026-06-09T15:30:06.676247Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1 2026-06-09T15:30:06.676339Z info delta EDS: PUSH INC for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:94B empty:1 cached:0/1 2026-06-09T15:30:06.676249Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:2 removed:0 size:1.3kB cached:0/1 2026-06-09T15:30:06.676512Z info delta EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:94B empty:0 cached:1/1 2026-06-09T15:30:06.676661Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:30:06.676759Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:30:06.676878Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-09T15:30:06.677083Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:19.4kB cached:0/0 2026-06-09T15:30:06.947072Z info ads Push debounce stable[127] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.238143ms since last change, 100.238057ms since last push, full=true 2026-06-09T15:30:06.950649Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:30:06.951000Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:30:06.951001Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:30:06.953431Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:44.4kB 2026-06-09T15:30:10.691960Z info ads Push debounce stable[128] 1 for config Secret/llm/e2e-distinct-2-simulated-kserve-self-signed-certs: 100.214096ms since last change, 100.214034ms since last push, full=false 2026-06-09T15:30:10.692035Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:30:18.085519Z info ads Push debounce stable[129] 1 for config Secret/llm/e2e-distinct-simulated-kserve-self-signed-certs: 100.21034ms since last change, 100.210241ms since last push, full=false 2026-06-09T15:30:18.085567Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:30:20.760034Z info ads Push debounce stable[130] 1 for config ServiceEntry/llm/e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.791407ms since last change, 100.791333ms since last push, full=false 2026-06-09T15:30:20.760103Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:30:24.390508Z info ads Push debounce stable[131] 1 for config Secret/llm/e2e-trlp-test-simulated-kserve-self-signed-certs: 100.221643ms since last change, 100.22158ms since last push, full=false 2026-06-09T15:30:24.390558Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:30:25.011153Z info ads Push debounce stable[132] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.703884ms since last change, 100.703793ms since last push, full=false 2026-06-09T15:30:25.011227Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:30:29.096887Z info ads Push debounce stable[133] 1 for config Secret/llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs: 100.251266ms since last change, 100.251193ms since last push, full=false 2026-06-09T15:30:29.096937Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:30:37.023702Z info ads Push debounce stable[134] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.670932ms since last change, 100.670888ms since last push, full=false 2026-06-09T15:30:37.023754Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:30:39.893474Z info ads Push debounce stable[135] 1 for config Secret/llm/facebook-opt-125m-simulated-kserve-self-signed-certs: 100.220575ms since last change, 100.220142ms since last push, full=false 2026-06-09T15:30:39.893525Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:30:53.396527Z info ads Push debounce stable[136] 1 for config Secret/llm/premium-simulated-simulated-premium-kserve-self-signed-certs: 100.218921ms since last change, 100.218828ms since last push, full=false 2026-06-09T15:30:53.396578Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:31:40.404457Z info ads Push debounce stable[137] 1 for config ServiceEntry/llm/facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local: 100.173258ms since last change, 100.173179ms since last push, full=false 2026-06-09T15:31:40.404528Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:32:25.628627Z info ads Push debounce stable[138] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.608769ms since last change, 100.608716ms since last push, full=false 2026-06-09T15:32:25.628711Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:32:46.466955Z info ads Push debounce stable[139] 1 for config ServiceEntry/llm/premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local: 100.804316ms since last change, 100.804229ms since last push, full=false 2026-06-09T15:32:46.467034Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:32:48.253392Z info ads Push debounce stable[140] 7 for config ConfigMap/premium-users-namespace/kube-root-ca.crt and 3 more configs: 100.729743ms since last change, 139.191258ms since last push, full=false 2026-06-09T15:32:48.253456Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:32:48.447720Z info ads Push debounce stable[141] 2 for config Secret/premium-users-namespace/premium-service-account-dockercfg-m9tc4: 100.616343ms since last change, 113.874588ms since last push, full=false 2026-06-09T15:32:48.447766Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:32:49.074600Z info ads Push debounce stable[142] 6 for config ServiceEntry/kuadrant-system/authorino-authorino-oidc.kuadrant-system.svc.cluster.local and 2 more configs: 100.603751ms since last change, 148.473909ms since last push, full=false 2026-06-09T15:32:49.074652Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:32:49.414262Z info ads Push debounce stable[143] 10 for config Secret/maas-admin/builder-dockercfg-pt5g4 and 6 more configs: 100.20345ms since last change, 158.063721ms since last push, full=false 2026-06-09T15:32:49.414332Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:32:49.582460Z info ads Push debounce stable[144] 2 for config Secret/maas-admin/tester-admin-user-dockercfg-xlkd9: 100.873547ms since last change, 113.564747ms since last push, full=false 2026-06-09T15:32:49.582507Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:32:51.043126Z info ads Push debounce stable[145] 2 for config Secret/default/tester-regular-user-dockercfg-qf556: 100.184528ms since last change, 113.472446ms since last push, full=false 2026-06-09T15:32:51.043176Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:32:51.722427Z info ads Push debounce stable[146] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.96196ms since last change, 100.961895ms since last push, full=false 2026-06-09T15:32:51.722503Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:33:12.415817Z info ads Push debounce stable[147] 2 for config Secret/llm/e2e-apikey-active-sa-dockercfg-gkznc: 100.175573ms since last change, 121.561531ms since last push, full=false 2026-06-09T15:33:12.415882Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:33:13.617555Z info ads Push debounce stable[148] 1 for config Secret/llm/e2e-apikey-active-sa-dockercfg-gkznc: 100.212657ms since last change, 100.212581ms since last push, full=false 2026-06-09T15:33:13.617606Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:33:21.751624Z info ads Push debounce stable[149] 2 for config Secret/llm/e2e-apikey-degraded-sa-dockercfg-fj887: 100.944037ms since last change, 112.404316ms since last push, full=false 2026-06-09T15:33:21.751676Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:30:06Z/77 2026-06-09T15:33:23.747493Z info ads Push debounce stable[150] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.221757ms since last change, 100.221653ms since last push, full=true 2026-06-09T15:33:23.751468Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:23Z/78 2026-06-09T15:33:23.751782Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:23.751783Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:23.754555Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:26.149741Z info ads Push debounce stable[151] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.19126ms since last change, 100.191185ms since last push, full=true 2026-06-09T15:33:26.153693Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:26Z/79 2026-06-09T15:33:26.154073Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:26.154074Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:26.156955Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:27.949856Z info ads Push debounce stable[152] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.213498ms since last change, 100.213422ms since last push, full=true 2026-06-09T15:33:27.953684Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:27Z/80 2026-06-09T15:33:27.954013Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:27.954015Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:27.957067Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:29.071521Z info ads Push debounce stable[153] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.206557ms since last change, 100.206505ms since last push, full=true 2026-06-09T15:33:29.075333Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:29Z/81 2026-06-09T15:33:29.075692Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:29.075695Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:29.078667Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:30.047523Z info ads Push debounce stable[154] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.226075ms since last change, 100.226005ms since last push, full=true 2026-06-09T15:33:30.051361Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:30Z/82 2026-06-09T15:33:30.051654Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:30.051653Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:30.054867Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:32.837722Z info ads Push debounce stable[155] 1 for config Secret/llm/e2e-apikey-degraded-sa-dockercfg-fj887: 100.757503ms since last change, 100.757427ms since last push, full=false 2026-06-09T15:33:32.837787Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:33:30Z/82 2026-06-09T15:33:33.447955Z info ads Push debounce stable[156] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.217102ms since last change, 100.217012ms since last push, full=true 2026-06-09T15:33:33.452444Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:33Z/83 2026-06-09T15:33:33.452779Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:33.452811Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:33.455699Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:44.4kB 2026-06-09T15:33:40.957035Z info ads Push debounce stable[157] 2 for config Secret/llm/e2e-apikey-failed-sa-dockercfg-p9m7r: 100.512924ms since last change, 112.4723ms since last push, full=false 2026-06-09T15:33:40.957109Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:33:33Z/83 2026-06-09T15:33:42.752386Z info ads Push debounce stable[158] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.218211ms since last change, 100.218143ms since last push, full=true 2026-06-09T15:33:42.756636Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:42Z/84 2026-06-09T15:33:42.757014Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:42.757024Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:42.759794Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:45.155552Z info ads Push debounce stable[159] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.229571ms since last change, 100.22948ms since last push, full=true 2026-06-09T15:33:45.159444Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:45Z/85 2026-06-09T15:33:45.159780Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:45.159776Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:45.162572Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:47.154095Z info ads Push debounce stable[160] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.213308ms since last change, 100.213256ms since last push, full=true 2026-06-09T15:33:47.157949Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:47Z/86 2026-06-09T15:33:47.158267Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:47.158268Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:47.161457Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:48.438028Z info ads Push debounce stable[161] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.210729ms since last change, 100.210662ms since last push, full=true 2026-06-09T15:33:48.441956Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:48Z/87 2026-06-09T15:33:48.442341Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:48.442340Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:48.445715Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:49.358171Z info ads Push debounce stable[162] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.208846ms since last change, 100.20877ms since last push, full=true 2026-06-09T15:33:49.362070Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:49Z/88 2026-06-09T15:33:49.362367Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:49.362366Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:49.365176Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:50.541943Z info ads Push debounce stable[163] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.204396ms since last change, 100.204325ms since last push, full=true 2026-06-09T15:33:50.545701Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:50Z/89 2026-06-09T15:33:50.546035Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:50.546035Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:50.549320Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:51.644183Z info ads Push debounce stable[164] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.222268ms since last change, 100.222181ms since last push, full=true 2026-06-09T15:33:51.648046Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:51Z/90 2026-06-09T15:33:51.648366Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:51.648367Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:51.651044Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:33:52.167773Z info ads Push debounce stable[165] 1 for config Secret/llm/e2e-apikey-failed-sa-dockercfg-p9m7r: 100.206126ms since last change, 100.206056ms since last push, full=false 2026-06-09T15:33:52.167823Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:33:51Z/90 2026-06-09T15:33:53.243184Z info ads Push debounce stable[166] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.223341ms since last change, 100.22327ms since last push, full=true 2026-06-09T15:33:53.246859Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:33:53Z/91 2026-06-09T15:33:53.247177Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:33:53.247180Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:33:53.249979Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:44.4kB 2026-06-09T15:34:00.301073Z info ads Push debounce stable[167] 2 for config Secret/llm/e2e-apikey-pending-sa-dockercfg-7v2c8: 100.163198ms since last change, 111.618581ms since last push, full=false 2026-06-09T15:34:00.301148Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:33:53Z/91 2026-06-09T15:34:01.945524Z info ads Push debounce stable[168] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.403261ms since last change, 100.403176ms since last push, full=true 2026-06-09T15:34:01.949549Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:01Z/92 2026-06-09T15:34:01.949918Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:01.949964Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:01.952707Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:34:04.346831Z info ads Push debounce stable[169] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.223496ms since last change, 100.223411ms since last push, full=true 2026-06-09T15:34:04.350968Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:04Z/93 2026-06-09T15:34:04.351297Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:04.351298Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:04.354161Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:34:06.343264Z info ads Push debounce stable[170] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.215848ms since last change, 100.215772ms since last push, full=true 2026-06-09T15:34:06.347193Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:06Z/94 2026-06-09T15:34:06.347559Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:06.347559Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:06.350293Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:34:07.538254Z info ads Push debounce stable[171] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.220424ms since last change, 100.220353ms since last push, full=true 2026-06-09T15:34:07.542114Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:07Z/95 2026-06-09T15:34:07.542431Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:07.542433Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:07.545161Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:34:08.550785Z info ads Push debounce stable[172] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.213449ms since last change, 100.213365ms since last push, full=true 2026-06-09T15:34:08.554673Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:08Z/96 2026-06-09T15:34:08.555017Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:08.555020Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:08.557776Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:34:09.650874Z info ads Push debounce stable[173] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.594416ms since last change, 100.594351ms since last push, full=true 2026-06-09T15:34:09.654592Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:09Z/97 2026-06-09T15:34:09.654928Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:09.654928Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:09.657691Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:34:10.846802Z info ads Push debounce stable[174] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.211439ms since last change, 100.211355ms since last push, full=true 2026-06-09T15:34:10.850685Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:10Z/98 2026-06-09T15:34:10.851070Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:10.851070Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:10.854123Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.0kB 2026-06-09T15:34:11.569389Z info ads Push debounce stable[175] 1 for config Secret/llm/e2e-apikey-pending-sa-dockercfg-7v2c8: 100.208595ms since last change, 100.20852ms since last push, full=false 2026-06-09T15:34:11.569438Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:34:10Z/98 2026-06-09T15:34:12.364508Z info ads Push debounce stable[176] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.2102ms since last change, 100.210139ms since last push, full=true 2026-06-09T15:34:12.368028Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:12Z/99 2026-06-09T15:34:12.368384Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:12.368384Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:12.370970Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:44.4kB 2026-06-09T15:34:19.692255Z info ads Push debounce stable[177] 2 for config Secret/llm/e2e-apikey-unreconciled-sa-dockercfg-d9rv5: 100.327366ms since last change, 114.12825ms since last push, full=false 2026-06-09T15:34:19.692307Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:34:12Z/99 2026-06-09T15:34:20.172605Z info ads Push debounce stable[178] 1 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local: 100.043924ms since last change, 100.043844ms since last push, full=false 2026-06-09T15:34:20.172684Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:34:12Z/99 2026-06-09T15:34:20.341510Z info model Incremental push, service maas-controller-webhook-service.opendatahub.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-06-09T15:34:20.441776Z info ads Push debounce stable[179] 1 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local: 100.219643ms since last change, 100.219578ms since last push, full=false 2026-06-09T15:34:20.441868Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:34:12Z/99 2026-06-09T15:34:23.241663Z info ads Push debounce stable[180] 1 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local: 100.216471ms since last change, 100.216415ms since last push, full=false 2026-06-09T15:34:23.241728Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:34:12Z/99 2026-06-09T15:34:34.276440Z info ads Push debounce stable[181] 1 for config ServiceEntry/opendatahub/maas-controller-webhook-service.opendatahub.svc.cluster.local: 100.641589ms since last change, 100.641485ms since last push, full=false 2026-06-09T15:34:34.276511Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:34:12Z/99 2026-06-09T15:34:34.670002Z info ads Push debounce stable[182] 1 for config Secret/llm/e2e-apikey-unreconciled-sa-dockercfg-d9rv5: 100.208349ms since last change, 100.208282ms since last push, full=false 2026-06-09T15:34:34.670067Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:34:12Z/99 2026-06-09T15:34:40.329757Z info ads Push debounce stable[183] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.541743ms since last change, 100.541654ms since last push, full=false 2026-06-09T15:34:40.329815Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:34:12Z/99 2026-06-09T15:34:42.804605Z info ads Push debounce stable[184] 2 for config Secret/llm/e2e-filter-sa-9adf06ef-dockercfg-7h4kn: 100.230839ms since last change, 113.46417ms since last push, full=false 2026-06-09T15:34:42.804656Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:34:12Z/99 2026-06-09T15:34:44.668152Z info ads Push debounce stable[185] 1 for config Secret/llm/e2e-filter-sa-9adf06ef-dockercfg-7h4kn: 100.207832ms since last change, 100.207769ms since last push, full=false 2026-06-09T15:34:44.668200Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:34:12Z/99 2026-06-09T15:34:54.353537Z info ads Push debounce stable[186] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.213891ms since last change, 100.21383ms since last push, full=true 2026-06-09T15:34:54.357390Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:54Z/100 2026-06-09T15:34:54.357699Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:54.357702Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:54.360738Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:34:56.557470Z info ads Push debounce stable[187] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.220726ms since last change, 100.220635ms since last push, full=true 2026-06-09T15:34:56.563542Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:56Z/101 2026-06-09T15:34:56.564063Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:56.566661Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:56.569815Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:34:58.461016Z info ads Push debounce stable[188] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.214772ms since last change, 100.214686ms since last push, full=true 2026-06-09T15:34:58.465114Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:58Z/102 2026-06-09T15:34:58.465428Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:58.465433Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:58.468359Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:34:59.543922Z info ads Push debounce stable[189] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.548753ms since last change, 100.548676ms since last push, full=true 2026-06-09T15:34:59.547923Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:34:59Z/103 2026-06-09T15:34:59.548315Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:34:59.548315Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:34:59.551312Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:35:00.764946Z info ads Push debounce stable[190] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.122255ms since last change, 100.12219ms since last push, full=true 2026-06-09T15:35:00.768757Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:35:00Z/104 2026-06-09T15:35:00.769093Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:00.769093Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:00.771794Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:35:01.848643Z info ads Push debounce stable[191] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.223847ms since last change, 100.223775ms since last push, full=true 2026-06-09T15:35:01.852651Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:35:01Z/105 2026-06-09T15:35:01.853009Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:01.853011Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:01.856269Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:35:02.945255Z info ads Push debounce stable[192] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.210708ms since last change, 100.210633ms since last push, full=true 2026-06-09T15:35:02.949101Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:35:02Z/106 2026-06-09T15:35:02.949391Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:02.949392Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:02.952013Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:35:03.948560Z info ads Push debounce stable[193] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.229803ms since last change, 100.229721ms since last push, full=true 2026-06-09T15:35:03.952549Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:35:03Z/107 2026-06-09T15:35:03.952935Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:03.952968Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:03.955651Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:35:05.068797Z info ads Push debounce stable[194] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.221452ms since last change, 100.221329ms since last push, full=true 2026-06-09T15:35:05.072621Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:35:05Z/108 2026-06-09T15:35:05.072972Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:05.072975Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:05.075683Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:35:06.145502Z info ads Push debounce stable[195] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.21916ms since last change, 100.219086ms since last push, full=true 2026-06-09T15:35:06.149727Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:35:06Z/109 2026-06-09T15:35:06.150031Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:06.150030Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:06.152756Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:35:07.440999Z info ads Push debounce stable[196] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.741393ms since last change, 100.741311ms since last push, full=true 2026-06-09T15:35:07.445253Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:35:07Z/110 2026-06-09T15:35:07.445594Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:07.445593Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:07.448590Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:35:08.460643Z info ads Push debounce stable[197] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.10287ms since last change, 100.102797ms since last push, full=true 2026-06-09T15:35:08.464638Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:35:08Z/111 2026-06-09T15:35:08.465070Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:08.465070Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:08.468255Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:49.9kB 2026-06-09T15:35:10.186361Z info ads Push debounce stable[198] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.213696ms since last change, 100.213631ms since last push, full=true 2026-06-09T15:35:10.192066Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:35:10Z/112 2026-06-09T15:35:10.192383Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:10.192389Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:10.194814Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:44.4kB 2026-06-09T15:35:17.095065Z info ads Push debounce stable[199] 7 for config Secret/e2e-unwatched-ns/default-dockercfg-tgbdn and 3 more configs: 100.329144ms since last change, 141.09544ms since last push, full=false 2026-06-09T15:35:17.095147Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:35:10Z/112 2026-06-09T15:35:18.489533Z info ads Push debounce stable[200] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.60326ms since last change, 100.6032ms since last push, full=false 2026-06-09T15:35:18.489592Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:35:10Z/112 2026-06-09T15:35:46.174490Z info ads Push debounce stable[201] 3 for config Secret/e2e-unwatched-ns/deployer-dockercfg-xfx6j and 2 more configs: 100.254763ms since last change, 101.8464ms since last push, full=false 2026-06-09T15:35:46.174541Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:35:10Z/112 2026-06-09T15:35:46.640658Z info ads Push debounce stable[202] 1 for config ConfigMap/e2e-unwatched-ns/kube-root-ca.crt: 100.430258ms since last change, 100.430184ms since last push, full=false 2026-06-09T15:35:46.640703Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:35:10Z/112 2026-06-09T15:35:47.235811Z info ads Push debounce stable[203] 7 for config ConfigMap/e2e-modelref-95e62e/kube-root-ca.crt and 3 more configs: 100.234424ms since last change, 182.864838ms since last push, full=false 2026-06-09T15:35:47.235897Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:35:10Z/112 2026-06-09T15:35:47.334810Z info model Cache Update, new service e2e-modelref-95e62e/test.example.com 2026-06-09T15:35:47.420099Z info model Cache Update, new service llm/test.example.com 2026-06-09T15:35:47.571287Z info ads Push debounce stable[204] 10 for config DestinationRule/e2e-modelref-95e62e/test-backend and 6 more configs: 100.635103ms since last change, 267.112517ms since last push, full=true 2026-06-09T15:35:47.571958Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:35:47Z/113 2026-06-09T15:35:47.572584Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-06-09T15:35:47.572594Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-06-09T15:35:47.573199Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-09T15:35:47.573302Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-09T15:35:47.573496Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:47.573552Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:47.573595Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-09T15:35:47.574073Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:21.7kB cached:0/0 2026-06-09T15:35:49.046930Z info ads Push debounce stable[205] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.23293ms since last change, 100.232868ms since last push, full=true 2026-06-09T15:35:49.050977Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:35:49Z/114 2026-06-09T15:35:49.051295Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:35:49.051295Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:35:49.053987Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.4kB 2026-06-09T15:36:03.915129Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 3c2d75b9-d92c-4d83-8039-1604d733aa7c test-backend e2e-modelref-95e62e cluster.local map[app.kubernetes.io/managed-by:maas-external-model-reconciler maas.opendatahub.io/external-model:test-backend] map[] 31571 2026-06-09 15:35:47 +0000 UTC [{maas.opendatahub.io/v1alpha1 ExternalModel test-backend 60a14445-30ff-44c1-b3a5-5375dadbaa9e 0xc00198154d 0xc00198154c}] 1} 0xc004019008 0xc0015c3748 map[]}, will try again later: httproutes.gateway.networking.k8s.io "test-backend" not found 2026-06-09T15:36:04.012725Z info ads Push debounce stable[206] 4 for config ServiceEntry/e2e-modelref-95e62e/test-backend.e2e-modelref-95e62e.svc.cluster.local and 3 more configs: 100.195058ms since last change, 102.673372ms since last push, full=true 2026-06-09T15:36:04.013431Z info ads XDS: Pushing Services:109 ConnectedEndpoints:2 Version:2026-06-09T15:36:04Z/115 2026-06-09T15:36:04.014011Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:2 removed:0 size:1.2kB cached:0/1 2026-06-09T15:36:04.014019Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:4 removed:0 size:1.7kB cached:0/1 2026-06-09T15:36:04.014883Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-09T15:36:04.014883Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-09T15:36:04.015165Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:04.015240Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:04.015324Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-09T15:36:04.015666Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:20.5kB cached:0/0 2026-06-09T15:36:04.027617Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 37326c90-16a7-417a-a945-7312620e0ae6 test-backend llm cluster.local map[app.kubernetes.io/managed-by:maas-external-model-reconciler maas.opendatahub.io/external-model:test-backend] map[] 31570 2026-06-09 15:35:47 +0000 UTC [{maas.opendatahub.io/v1alpha1 ExternalModel test-backend c5f0b2b3-99d1-431e-9dad-2e29255cce3c 0xc001981090 0xc00198107f}] 1} 0xc0008f5d88 0xc0039750c8 map[]}, will try again later: httproutes.gateway.networking.k8s.io "test-backend" not found 2026-06-09T15:36:04.121714Z info ads Push debounce stable[207] 4 for config ServiceEntry/llm/test-backend.llm.svc.cluster.local and 3 more configs: 100.697973ms since last change, 104.769299ms since last push, full=true 2026-06-09T15:36:04.122331Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:36:04Z/116 2026-06-09T15:36:04.122806Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:3 removed:1 size:507B 2026-06-09T15:36:04.122805Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:1 size:44B 2026-06-09T15:36:04.123478Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-09T15:36:04.123529Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-09T15:36:04.123735Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:04.123780Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:04.123872Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-09T15:36:04.124189Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:19.4kB cached:0/0 2026-06-09T15:36:05.651123Z info ads Push debounce stable[208] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.216061ms since last change, 100.216ms since last push, full=true 2026-06-09T15:36:05.654635Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:36:05Z/117 2026-06-09T15:36:05.654986Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:05.654988Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:05.657647Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:44.4kB 2026-06-09T15:36:09.414953Z info ads Push debounce stable[209] 4 for config Secret/e2e-modelref-95e62e/builder-dockercfg-sfxrk and 3 more configs: 100.775223ms since last change, 111.848416ms since last push, full=false 2026-06-09T15:36:09.415006Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:36:05Z/117 2026-06-09T15:36:18.098482Z info model Cache Update, new service e2e-modelref-1e0bdd/test.example.com 2026-06-09T15:36:18.200632Z info model Cache Update, new service llm/test.example.com 2026-06-09T15:36:18.318565Z info ads Push debounce stable[210] 17 for config ServiceEntry/e2e-modelref-1e0bdd/test.example.com and 10 more configs: 100.163366ms since last change, 348.305064ms since last push, full=true 2026-06-09T15:36:18.319230Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:18Z/118 2026-06-09T15:36:18.321186Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:138 removed:0 size:159.7kB cached:122/137 2026-06-09T15:36:18.321206Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:140 removed:0 size:160.1kB cached:122/137 2026-06-09T15:36:18.321944Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-09T15:36:18.322020Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-09T15:36:18.322176Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:18.322208Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:18.322283Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-09T15:36:18.322316Z info delta SDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1 2026-06-09T15:36:18.322552Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:21.7kB cached:0/0 2026-06-09T15:36:18.322582Z info delta SDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-06-09T15:36:19.517151Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-06-09T15:36:20.040105Z info ads Push debounce stable[211] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.210995ms since last change, 100.210915ms since last push, full=true 2026-06-09T15:36:20.044632Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:20Z/119 2026-06-09T15:36:20.044957Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:20.044960Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:20.048506Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:55.9kB 2026-06-09T15:36:22.849565Z info ads Push debounce stable[212] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.09368ms since last change, 100.093612ms since last push, full=true 2026-06-09T15:36:22.853827Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:22Z/120 2026-06-09T15:36:22.854138Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:22.854144Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:22.857497Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:55.9kB 2026-06-09T15:36:24.949917Z info ads Push debounce stable[213] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.213941ms since last change, 100.213879ms since last push, full=true 2026-06-09T15:36:24.954291Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:24Z/121 2026-06-09T15:36:24.954667Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:24.954669Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:24.958133Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:55.9kB 2026-06-09T15:36:26.455298Z info ads Push debounce stable[214] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.220034ms since last change, 100.21997ms since last push, full=true 2026-06-09T15:36:26.459731Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:26Z/122 2026-06-09T15:36:26.460119Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:26.460121Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:26.463780Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:55.9kB 2026-06-09T15:36:27.759006Z info ads Push debounce stable[215] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.603183ms since last change, 100.603121ms since last push, full=true 2026-06-09T15:36:27.763345Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:27Z/123 2026-06-09T15:36:27.763673Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:27.763700Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:27.766748Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:55.9kB 2026-06-09T15:36:28.962317Z info ads Push debounce stable[216] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 101.040194ms since last change, 101.040143ms since last push, full=true 2026-06-09T15:36:28.966612Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:28Z/124 2026-06-09T15:36:28.966943Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:28.966944Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:28.969890Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:55.9kB 2026-06-09T15:36:30.244512Z info ads Push debounce stable[217] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.233172ms since last change, 100.233084ms since last push, full=true 2026-06-09T15:36:30.248919Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:30Z/125 2026-06-09T15:36:30.249233Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:30.249231Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:30.252752Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:55.9kB 2026-06-09T15:36:31.448486Z info ads Push debounce stable[218] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.425885ms since last change, 100.425813ms since last push, full=true 2026-06-09T15:36:31.452774Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:31Z/126 2026-06-09T15:36:31.453105Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:31.453110Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:31.456096Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:55.9kB 2026-06-09T15:36:32.546114Z info ads Push debounce stable[219] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.212076ms since last change, 100.212ms since last push, full=true 2026-06-09T15:36:32.550363Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:32Z/127 2026-06-09T15:36:32.550664Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:32.550666Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:32.553758Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:55.9kB 2026-06-09T15:36:33.941955Z info ads Push debounce stable[220] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.700324ms since last change, 100.700251ms since last push, full=true 2026-06-09T15:36:33.946227Z info ads XDS: Pushing Services:111 ConnectedEndpoints:2 Version:2026-06-09T15:36:33Z/128 2026-06-09T15:36:33.946516Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:33.946520Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:33.949527Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:55.9kB 2026-06-09T15:36:34.673384Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 7fe5e7b8-b988-4675-ab32-fc5df247a4ec test-backend e2e-modelref-1e0bdd cluster.local map[app.kubernetes.io/managed-by:maas-external-model-reconciler maas.opendatahub.io/external-model:test-backend] map[] 32071 2026-06-09 15:36:18 +0000 UTC [{maas.opendatahub.io/v1alpha1 ExternalModel test-backend 9f77eccf-d5f5-4a3c-b185-3d7b6079ac98 0xc004537b7d 0xc004537b7c}] 1} 0xc003cd9308 0xc0046c73e8 map[]}, will try again later: httproutes.gateway.networking.k8s.io "test-backend" not found 2026-06-09T15:36:34.782416Z error status Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 76822812-f3be-43ca-a742-b989fa0fb84c test-backend llm cluster.local map[app.kubernetes.io/managed-by:maas-external-model-reconciler maas.opendatahub.io/external-model:test-backend] map[] 32074 2026-06-09 15:36:18 +0000 UTC [{maas.opendatahub.io/v1alpha1 ExternalModel test-backend dba5499f-3d60-4ff3-9cdb-89a9d8d53ddf 0xc003dce4ba 0xc003dce4b9}] 1} 0xc004c6e408 0xc003523cc8 map[]}, will try again later: httproutes.gateway.networking.k8s.io "test-backend" not found 2026-06-09T15:36:34.875721Z info ads Push debounce stable[221] 8 for config VirtualService/opendatahub/openshift-ingress~maas-default-gateway-istio-autogenerated-k8s-gateway-https~* and 6 more configs: 100.164859ms since last change, 206.148391ms since last push, full=true 2026-06-09T15:36:34.876369Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:36:34Z/129 2026-06-09T15:36:34.876772Z info delta CDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:1 size:44B 2026-06-09T15:36:34.877251Z info delta CDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:3 removed:1 size:507B 2026-06-09T15:36:34.883540Z info delta EDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-09T15:36:34.884021Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:34.884133Z info delta EDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:136 removed:0 size:32.7kB empty:0 cached:136/136 2026-06-09T15:36:34.884178Z info delta RDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:732B cached:0/0 2026-06-09T15:36:34.884919Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:34.885244Z info delta RDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:19.4kB cached:0/0 2026-06-09T15:36:36.246577Z info ads Push debounce stable[222] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.210563ms since last change, 100.210473ms since last push, full=true 2026-06-09T15:36:36.250379Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:36:36Z/130 2026-06-09T15:36:36.250749Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:36.250750Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:36.253316Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:44.4kB 2026-06-09T15:36:40.071700Z info ads Push debounce stable[223] 3 for config Secret/e2e-modelref-1e0bdd/builder-dockercfg-p5ssq and 2 more configs: 100.262481ms since last change, 104.036747ms since last push, full=false 2026-06-09T15:36:40.071762Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:36:36Z/130 2026-06-09T15:36:40.294641Z info ads Push debounce stable[224] 1 for config ConfigMap/e2e-modelref-1e0bdd/kube-root-ca.crt: 100.455964ms since last change, 100.455876ms since last push, full=false 2026-06-09T15:36:40.294704Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:36:36Z/130 2026-06-09T15:36:57.444495Z info ads Push debounce stable[225] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.213216ms since last change, 100.213145ms since last push, full=true 2026-06-09T15:36:57.448373Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:36:57Z/131 2026-06-09T15:36:57.448768Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:57.448768Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:57.451702Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:50.1kB 2026-06-09T15:36:59.108507Z info ads Push debounce stable[226] 7 for config ConfigMap/e2e-webhook-test-0d4c6e/kube-root-ca.crt and 3 more configs: 100.49013ms since last change, 151.24514ms since last push, full=false 2026-06-09T15:36:59.108575Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:36:57Z/131 2026-06-09T15:36:59.940498Z info ads Push debounce stable[227] 1 for config WasmPlugin/openshift-ingress/kuadrant-maas-default-gateway: 100.206888ms since last change, 100.206827ms since last push, full=true 2026-06-09T15:36:59.944007Z info ads XDS: Pushing Services:107 ConnectedEndpoints:2 Version:2026-06-09T15:36:59Z/132 2026-06-09T15:36:59.944385Z info delta LDS: PUSH for node:data-science-gateway-data-science-gateway-class-74759f9795mq6n9.openshift-ingress resources:1 removed:0 size:7.2kB 2026-06-09T15:36:59.944384Z info delta LDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:4.5kB 2026-06-09T15:36:59.946961Z info delta ECDS: PUSH for node:maas-default-gateway-openshift-default-687ff6996-s6xbs.openshift-ingress resources:1 removed:0 size:44.4kB 2026-06-09T15:37:04.435723Z info ads Push debounce stable[228] 1 for config ConfigMap/e2e-webhook-test-0d4c6e/kube-root-ca.crt: 100.652353ms since last change, 100.652272ms since last push, full=false 2026-06-09T15:37:04.435773Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:36:59Z/132 2026-06-09T15:37:04.706699Z info ads Push debounce stable[229] 3 for config Secret/e2e-webhook-test-0d4c6e/builder-dockercfg-lq8tz and 2 more configs: 100.737278ms since last change, 105.687646ms since last push, full=false 2026-06-09T15:37:04.706761Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:36:59Z/132 2026-06-09T15:37:05.305919Z info ads Push debounce stable[230] 7 for config ConfigMap/e2e-webhook-test-34382f/kube-root-ca.crt and 3 more configs: 100.978725ms since last change, 154.675903ms since last push, full=false 2026-06-09T15:37:05.305969Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:36:59Z/132 2026-06-09T15:37:07.088812Z info ads Push debounce stable[231] 1 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local: 100.723364ms since last change, 100.723287ms since last push, full=false 2026-06-09T15:37:07.088886Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:36:59Z/132 2026-06-09T15:37:09.517958Z info ads Push Status: { "pilot_eds_no_instances": { "outbound|9004||payload-processing.openshift-ingress.svc.cluster.local": {} } } 2026-06-09T15:37:10.547836Z info ads Push debounce stable[232] 3 for config Secret/e2e-webhook-test-34382f/builder-dockercfg-m9j7n and 2 more configs: 100.078112ms since last change, 103.240073ms since last push, full=false 2026-06-09T15:37:10.547932Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:36:59Z/132 2026-06-09T15:37:10.796069Z info ads Push debounce stable[233] 1 for config ConfigMap/e2e-webhook-test-34382f/kube-root-ca.crt: 100.392345ms since last change, 100.392272ms since last push, full=false 2026-06-09T15:37:10.796120Z info ads XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-06-09T15:36:59Z/132