2026-07-16T17:57:07.950027Z	info	ads	Push debounce stable[670] 2 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4816ad and 1 more configs: 100.977098ms since last change, 200.380743ms since last push, full=true
2026-07-16T17:57:07.964620Z	info	ads	XDS: Pushing Services:117 ConnectedEndpoints:4 Version:2026-07-16T17:57:07Z/360
2026-07-16T17:57:07.964974Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:07.965064Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:07.964975Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:57:07.964975Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:07.967447Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:48.5kB
2026-07-16T17:57:07.969363Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:48.5kB
2026-07-16T17:57:07.973265Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:57:11.118645Z	info	ads	Push debounce stable[671] 5 for config Secret/openshift-monitoring/openshift-state-metrics-dockercfg-cpvxj and 4 more configs: 100.221196ms since last change, 103.761114ms since last push, full=false
2026-07-16T17:57:11.118694Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:57:07Z/360
2026-07-16T17:57:12.118118Z	info	ads	Push debounce stable[672] 2 for config Secret/openshift-monitoring/thanos-querier-dockercfg-bv78m and 1 more configs: 100.506904ms since last change, 103.161412ms since last push, full=false
2026-07-16T17:57:12.118169Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:57:07Z/360
2026-07-16T17:57:13.114495Z	info	ads	Push debounce stable[673] 1 for config Secret/openshift-monitoring/prometheus-k8s-dockercfg-jn42z: 100.235344ms since last change, 100.235283ms since last push, full=false
2026-07-16T17:57:13.114544Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:57:07Z/360
2026-07-16T17:57:16.114513Z	info	ads	Push debounce stable[674] 1 for config Secret/openshift-monitoring/monitoring-plugin-dockercfg-cdqxd: 100.220408ms since last change, 100.220349ms since last push, full=false
2026-07-16T17:57:16.114570Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:57:07Z/360
2026-07-16T17:57:17.449483Z	info	ads	Push debounce stable[675] 2 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-6a2606 and 1 more configs: 100.130621ms since last change, 195.317475ms since last push, full=true
2026-07-16T17:57:17.464169Z	info	ads	XDS: Pushing Services:117 ConnectedEndpoints:4 Version:2026-07-16T17:57:17Z/361
2026-07-16T17:57:17.464498Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:17.464504Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:57:17.464507Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:17.464507Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:17.467118Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:48.5kB
2026-07-16T17:57:17.467154Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:48.5kB
2026-07-16T17:57:17.471280Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:57:22.710103Z	info	model	Incremental push, service sub-test-model-6a2606-kserve-workload-svc.ai-tenant-e2e-shared-a-6a2606.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints
2026-07-16T17:57:22.713800Z	error	status	Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 9381b62b-1ef8-42f5-84c7-00f661b192a8 sub-test-model-6a2606-kserve-route ai-tenant-e2e-shared-a-6a2606 cluster.local map[app.kubernetes.io/component:llminferenceservice-router app.kubernetes.io/name:sub-test-model-6a2606 app.kubernetes.io/part-of:llminferenceservice] map[] 54117 2026-07-16 17:56:05 +0000 UTC [{serving.kserve.io/v1alpha2 LLMInferenceService sub-test-model-6a2606 578ce229-7766-4e79-af22-78807097b073 0xc0063da2f7 0xc0063da2f6}] 1} 0xc004080a08 0xc0009a37e8 map[]}, will try again later: httproutes.gateway.networking.k8s.io "sub-test-model-6a2606-kserve-route" not found
2026-07-16T17:57:22.811062Z	info	ads	Push debounce stable[676] 6 for config Secret/ai-tenant-e2e-shared-a-6a2606/kserve-metrics-reader-sa-dockercfg-rxjz8 and 4 more configs: 100.915562ms since last change, 156.92473ms since last push, full=true
2026-07-16T17:57:22.811745Z	info	ads	XDS: Pushing Services:116 ConnectedEndpoints:4 Version:2026-07-16T17:57:22Z/362
2026-07-16T17:57:22.812215Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:1 size:44B
2026-07-16T17:57:22.812366Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:57:22.812406Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:57:22.812535Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:57:22.813297Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:147 removed:0 size:35.4kB empty:1 cached:146/147
2026-07-16T17:57:22.813399Z	info	delta	EDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:147 removed:0 size:35.4kB empty:1 cached:146/147
2026-07-16T17:57:22.813302Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:147 removed:0 size:35.4kB empty:1 cached:146/147
2026-07-16T17:57:22.813601Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:22.813309Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:147 removed:0 size:35.4kB empty:1 cached:146/147
2026-07-16T17:57:22.813701Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:22.813827Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:57:22.813844Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:57:22.813877Z	info	delta	SDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:22.813914Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:22.813706Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:57:22.813997Z	info	delta	SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1
2026-07-16T17:57:22.814205Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:11.8kB cached:0/0
2026-07-16T17:57:22.814262Z	info	delta	SDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:22.814726Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0
2026-07-16T17:57:22.814758Z	info	delta	SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:23.351163Z	info	ads	Push debounce stable[677] 1 for config Secret/ai-tenant-e2e-shared-b-4816ad/kserve-metrics-reader-sa-dockercfg-lhdd8: 100.214247ms since last change, 100.214168ms since last push, full=false
2026-07-16T17:57:23.351211Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:57:22Z/362
2026-07-16T17:57:23.470064Z	info	model	Incremental push, service sub-test-model-4816ad-kserve-workload-svc.ai-tenant-e2e-shared-b-4816ad.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints
2026-07-16T17:57:23.473950Z	error	status	Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 260c2b63-3cac-4a84-afee-4a4ed072e0b0 sub-test-model-4816ad-kserve-route ai-tenant-e2e-shared-b-4816ad cluster.local map[app.kubernetes.io/component:llminferenceservice-router app.kubernetes.io/name:sub-test-model-4816ad app.kubernetes.io/part-of:llminferenceservice] map[] 54114 2026-07-16 17:56:28 +0000 UTC [{serving.kserve.io/v1alpha2 LLMInferenceService sub-test-model-4816ad fe534e48-b9e1-40b0-beac-e75b09015dca 0xc006a57f2d 0xc006a57f2c}] 1} 0xc004080708 0xc003050528 map[]}, will try again later: httproutes.gateway.networking.k8s.io "sub-test-model-4816ad-kserve-route" not found
2026-07-16T17:57:23.570837Z	info	ads	Push debounce stable[678] 5 for config Secret/ai-tenant-e2e-shared-b-4816ad/sub-test-model-4816ad-kserve-self-signed-certs and 3 more configs: 100.73858ms since last change, 110.610219ms since last push, full=true
2026-07-16T17:57:23.571526Z	info	ads	XDS: Pushing Services:115 ConnectedEndpoints:4 Version:2026-07-16T17:57:23Z/363
2026-07-16T17:57:23.572083Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:57:23.572084Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:1 size:44B
2026-07-16T17:57:23.572253Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:57:23.572303Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:57:23.573030Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:146 removed:0 size:35.2kB empty:1 cached:145/146
2026-07-16T17:57:23.573081Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:146 removed:0 size:35.2kB empty:1 cached:145/146
2026-07-16T17:57:23.573155Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:146 removed:0 size:35.2kB empty:1 cached:145/146
2026-07-16T17:57:23.573283Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:23.573299Z	info	delta	EDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:146 removed:0 size:35.2kB empty:1 cached:145/146
2026-07-16T17:57:23.573363Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:23.573423Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:57:23.573526Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:23.573548Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:57:23.573602Z	info	delta	SDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:23.573554Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:57:23.573658Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:57:23.573668Z	info	delta	SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1
2026-07-16T17:57:23.573721Z	info	delta	SDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:23.574460Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0
2026-07-16T17:57:23.574501Z	info	delta	SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:25.575123Z	info	model	Incremental push, service rate-test-model-6a2606-kserve-workload-svc.ai-tenant-e2e-shared-a-6a2606.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints
2026-07-16T17:57:25.727314Z	info	ads	Push debounce stable[679] 7 for config Secret/ai-tenant-e2e-shared-a-6a2606/rate-test-model-6a2606-kserve-self-signed-certs and 4 more configs: 100.198595ms since last change, 180.206258ms since last push, full=true
2026-07-16T17:57:25.728083Z	info	ads	XDS: Pushing Services:116 ConnectedEndpoints:4 Version:2026-07-16T17:57:25Z/364
2026-07-16T17:57:25.728655Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1
2026-07-16T17:57:25.728691Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:25.728855Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:25.729027Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:25.729476Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:145 removed:0 size:35.1kB empty:0 cached:145/145
2026-07-16T17:57:25.729525Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:145 removed:0 size:35.1kB empty:0 cached:145/145
2026-07-16T17:57:25.729623Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:145 removed:0 size:35.1kB empty:0 cached:145/145
2026-07-16T17:57:25.729711Z	info	delta	EDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:145 removed:0 size:35.1kB empty:0 cached:145/145
2026-07-16T17:57:25.729741Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:25.729853Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:57:25.729914Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:57:25.729952Z	info	delta	SDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:25.729952Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:25.730000Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:25.730054Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:57:25.730088Z	info	delta	SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1
2026-07-16T17:57:25.730326Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0
2026-07-16T17:57:25.730362Z	info	delta	SDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:25.730939Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0
2026-07-16T17:57:25.730977Z	info	delta	SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:25.733538Z	info	delta	EDS: PUSH request for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:107B empty:1 cached:0/1 filtered:145
2026-07-16T17:57:25.733545Z	info	delta	EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 filtered:145
2026-07-16T17:57:25.733627Z	info	delta	EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 filtered:145
2026-07-16T17:57:25.733857Z	info	delta	EDS: PUSH request for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 filtered:145
2026-07-16T17:57:26.172614Z	info	model	Full push, new service ai-tenant-e2e-shared-a-6a2606/rate-test-model-6a2606-kserve-workload-svc.ai-tenant-e2e-shared-a-6a2606.svc.cluster.local
2026-07-16T17:57:26.272781Z	info	ads	Push debounce stable[680] 1 for config ServiceEntry/ai-tenant-e2e-shared-a-6a2606/rate-test-model-6a2606-kserve-workload-svc.ai-tenant-e2e-shared-a-6a2606.svc.cluster.local: 100.12825ms since last change, 100.128175ms since last push, full=true
2026-07-16T17:57:26.273400Z	info	ads	XDS: Pushing Services:116 ConnectedEndpoints:4 Version:2026-07-16T17:57:26Z/365
2026-07-16T17:57:26.274001Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1
2026-07-16T17:57:26.274026Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:26.274092Z	info	delta	EDS: PUSH INC for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:107B empty:1 cached:0/1
2026-07-16T17:57:26.274109Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:26.274164Z	info	delta	EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:107B empty:1 cached:0/1
2026-07-16T17:57:26.274178Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:26.274247Z	info	delta	EDS: PUSH INC for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1
2026-07-16T17:57:26.274170Z	info	delta	EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1
2026-07-16T17:57:26.274341Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:26.274375Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:26.274447Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:26.274519Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:57:26.274453Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:57:26.274630Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:57:26.274653Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0
2026-07-16T17:57:26.275577Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0
2026-07-16T17:57:26.839305Z	info	ads	Push Status: {
    "pilot_duplicate_envoy_clusters": {
        "kuadrant-auth-service": {
            "proxy": "e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress",
            "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS"
        }
    },
    "pilot_eds_no_instances": {
        "outbound|8000||rate-test-model-6a2606-kserve-workload-svc.ai-tenant-e2e-shared-a-6a2606.svc.cluster.local": {}
    }
}
2026-07-16T17:57:31.559474Z	info	ads	Push debounce stable[681] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-6a2606: 100.220061ms since last change, 100.219981ms since last push, full=true
2026-07-16T17:57:31.573569Z	info	ads	XDS: Pushing Services:116 ConnectedEndpoints:4 Version:2026-07-16T17:57:31Z/366
2026-07-16T17:57:31.573926Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:31.574004Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:31.573926Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:57:31.573927Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:31.576444Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:30.5kB
2026-07-16T17:57:31.577604Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:48.5kB
2026-07-16T17:57:31.580874Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:57:31.670144Z	info	ads	Push debounce stable[682] 1 for config Secret/ai-tenant-e2e-shared-a-6a2606/rate-test-model-6a2606-kserve-self-signed-certs: 100.963919ms since last change, 100.963845ms since last push, full=false
2026-07-16T17:57:31.670183Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:57:31Z/366
2026-07-16T17:57:32.141078Z	info	ads	Push debounce stable[683] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4816ad: 100.216276ms since last change, 100.216186ms since last push, full=true
2026-07-16T17:57:32.154841Z	info	ads	XDS: Pushing Services:116 ConnectedEndpoints:4 Version:2026-07-16T17:57:32Z/367
2026-07-16T17:57:32.155153Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:32.155162Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:32.155156Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:32.155198Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:57:32.156037Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:8.4kB
2026-07-16T17:57:32.156641Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:30.5kB
2026-07-16T17:57:32.162226Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:57:36.342638Z	info	ads	Push debounce stable[684] 1 for config ServiceEntry/ai-tenant-e2e-shared-a-6a2606/rate-test-model-6a2606-kserve-workload-svc.ai-tenant-e2e-shared-a-6a2606.svc.cluster.local: 100.802465ms since last change, 100.802398ms since last push, full=false
2026-07-16T17:57:36.342698Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:57:32Z/367
2026-07-16T17:57:48.740444Z	info	ads	Push debounce stable[685] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.693943ms since last change, 171.01552ms since last push, full=true
2026-07-16T17:57:48.742410Z	info	ads	XDS: Pushing Services:116 ConnectedEndpoints:4 Version:2026-07-16T17:57:48Z/368
2026-07-16T17:57:48.744015Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:149 removed:0 size:171.2kB cached:143/146
2026-07-16T17:57:48.745353Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:146 removed:0 size:35.3kB empty:0 cached:144/146
2026-07-16T17:57:48.746238Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:48.746518Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:57:48.746716Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:149 removed:0 size:171.2kB cached:143/146
2026-07-16T17:57:48.747697Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:8.4kB
2026-07-16T17:57:48.747746Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:147 removed:0 size:170.7kB cached:143/146
2026-07-16T17:57:48.749117Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:149 removed:0 size:171.2kB cached:143/146
2026-07-16T17:57:48.749974Z	info	delta	EDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:146 removed:0 size:35.3kB empty:0 cached:146/146
2026-07-16T17:57:48.750262Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:146 removed:0 size:35.3kB empty:0 cached:146/146
2026-07-16T17:57:48.750371Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:57:48.750549Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:48.750649Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:57:48.751119Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:146 removed:0 size:35.3kB empty:0 cached:146/146
2026-07-16T17:57:48.751126Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0
2026-07-16T17:57:48.751510Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:48.752712Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0
2026-07-16T17:57:48.753219Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:30.5kB
2026-07-16T17:57:48.759686Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:57:51.795627Z	info	model	Incremental push, service rate-test-model-4816ad-kserve-workload-svc.ai-tenant-e2e-shared-b-4816ad.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints
2026-07-16T17:57:51.907775Z	info	ads	Push debounce stable[686] 4 for config Secret/ai-tenant-e2e-shared-b-4816ad/rate-test-model-4816ad-kserve-self-signed-certs and 2 more configs: 100.070134ms since last change, 153.736241ms since last push, full=true
2026-07-16T17:57:51.908475Z	info	ads	XDS: Pushing Services:117 ConnectedEndpoints:4 Version:2026-07-16T17:57:51Z/369
2026-07-16T17:57:51.909063Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:2 removed:0 size:1.5kB cached:0/1
2026-07-16T17:57:51.909232Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:4 removed:0 size:2.0kB cached:0/1
2026-07-16T17:57:51.909271Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:4 removed:0 size:2.0kB cached:0/1
2026-07-16T17:57:51.909297Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:4 removed:0 size:2.0kB cached:0/1
2026-07-16T17:57:51.909373Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:51.909472Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:57:51.909481Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:51.909504Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:57:51.909579Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:51.909513Z	info	delta	SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1
2026-07-16T17:57:51.909939Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0
2026-07-16T17:57:51.909970Z	info	delta	SDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:51.910001Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0
2026-07-16T17:57:51.910038Z	info	delta	SDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:51.910590Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0
2026-07-16T17:57:51.910623Z	info	delta	SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:57:51.914914Z	info	delta	EDS: PUSH request for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:107B empty:1 cached:0/1 filtered:146
2026-07-16T17:57:51.915089Z	info	delta	EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 filtered:146
2026-07-16T17:57:51.916456Z	info	delta	EDS: PUSH request for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 filtered:146
2026-07-16T17:57:51.916698Z	info	delta	EDS: PUSH request for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1 filtered:146
2026-07-16T17:57:52.048798Z	info	ads	Push debounce stable[687] 1 for config DestinationRule/ai-tenant-e2e-shared-b-4816ad/rate-test-model-4816ad-kserve-workload-svc: 100.204095ms since last change, 100.204042ms since last push, full=true
2026-07-16T17:57:52.049017Z	info	ads	XDS: Pushing Services:117 ConnectedEndpoints:4 Version:2026-07-16T17:57:52Z/370
2026-07-16T17:57:52.049637Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1
2026-07-16T17:57:52.049753Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:52.049829Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:52.049830Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:52.050554Z	info	delta	EDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:147 removed:0 size:35.5kB empty:0 cached:147/147
2026-07-16T17:57:52.050584Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:147 removed:0 size:35.5kB empty:1 cached:146/147
2026-07-16T17:57:52.050683Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:147 removed:0 size:35.5kB empty:0 cached:147/147
2026-07-16T17:57:52.050732Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:147 removed:0 size:35.5kB empty:0 cached:147/147
2026-07-16T17:57:52.050844Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:57:52.050854Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:52.050880Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:52.050972Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:52.050944Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:57:52.051161Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0
2026-07-16T17:57:52.051401Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0
2026-07-16T17:57:52.051853Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0
2026-07-16T17:57:52.266559Z	info	ads	Push debounce stable[688] 2 for config Secret/ai-tenant-e2e-shared-b-4816ad/kserve-metrics-reader-sa-dockercfg-vf48h: 100.412266ms since last change, 111.080106ms since last push, full=false
2026-07-16T17:57:52.266622Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:57:52Z/370
2026-07-16T17:57:53.318858Z	info	model	Full push, new service ai-tenant-e2e-shared-b-4816ad/rate-test-model-4816ad-kserve-workload-svc.ai-tenant-e2e-shared-b-4816ad.svc.cluster.local
2026-07-16T17:57:53.419786Z	info	ads	Push debounce stable[689] 1 for config ServiceEntry/ai-tenant-e2e-shared-b-4816ad/rate-test-model-4816ad-kserve-workload-svc.ai-tenant-e2e-shared-b-4816ad.svc.cluster.local: 100.888868ms since last change, 100.888801ms since last push, full=true
2026-07-16T17:57:53.420408Z	info	ads	XDS: Pushing Services:117 ConnectedEndpoints:4 Version:2026-07-16T17:57:53Z/371
2026-07-16T17:57:53.421064Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:53.421118Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1
2026-07-16T17:57:53.421135Z	info	delta	EDS: PUSH INC for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:107B empty:1 cached:0/1
2026-07-16T17:57:53.421155Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:53.421188Z	info	delta	EDS: PUSH INC for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1
2026-07-16T17:57:53.421205Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:4 removed:0 size:1.8kB cached:0/1
2026-07-16T17:57:53.421236Z	info	delta	EDS: PUSH INC for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1
2026-07-16T17:57:53.421266Z	info	delta	EDS: PUSH INC for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:107B empty:0 cached:1/1
2026-07-16T17:57:53.421381Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:53.421408Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:53.421428Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:57:53.421459Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:53.421504Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:57:53.421709Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0
2026-07-16T17:57:53.421882Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0
2026-07-16T17:57:53.422488Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0
2026-07-16T17:57:56.839262Z	info	ads	Push Status: {
    "pilot_duplicate_envoy_clusters": {
        "kuadrant-auth-service": {
            "proxy": "maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress",
            "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS"
        }
    },
    "pilot_eds_no_instances": {
        "outbound|8000||rate-test-model-4816ad-kserve-workload-svc.ai-tenant-e2e-shared-b-4816ad.svc.cluster.local": {}
    }
}
2026-07-16T17:57:56.932456Z	info	ads	Push debounce stable[690] 3 for config EnvoyFilter/openshift-ingress/payload-processing and 2 more configs: 100.991963ms since last change, 169.948336ms since last push, full=true
2026-07-16T17:57:56.933869Z	info	ads	XDS: Pushing Services:117 ConnectedEndpoints:4 Version:2026-07-16T17:57:56Z/372
2026-07-16T17:57:56.935052Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:150 removed:0 size:172.5kB cached:145/147
2026-07-16T17:57:56.935430Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:148 removed:0 size:172.1kB cached:145/147
2026-07-16T17:57:56.935514Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:150 removed:0 size:172.5kB cached:145/147
2026-07-16T17:57:56.935520Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:150 removed:0 size:172.5kB cached:145/147
2026-07-16T17:57:56.935849Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:147 removed:0 size:35.5kB empty:0 cached:145/147
2026-07-16T17:57:56.936140Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:57:56.936424Z	info	delta	EDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:147 removed:0 size:35.5kB empty:0 cached:147/147
2026-07-16T17:57:56.936460Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:147 removed:0 size:35.5kB empty:0 cached:147/147
2026-07-16T17:57:56.936536Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:147 removed:0 size:35.5kB empty:0 cached:147/147
2026-07-16T17:57:56.936612Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:56.936625Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0
2026-07-16T17:57:56.936693Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:56.936784Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:57:56.936843Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:56.936935Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:11.9kB cached:0/0
2026-07-16T17:57:56.937277Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:8.4kB
2026-07-16T17:57:56.937723Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0
2026-07-16T17:57:56.938485Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:30.5kB
2026-07-16T17:57:56.943972Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:57:57.241652Z	info	ads	Push debounce stable[691] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4816ad: 100.198817ms since last change, 100.198755ms since last push, full=true
2026-07-16T17:57:57.254310Z	info	ads	XDS: Pushing Services:117 ConnectedEndpoints:4 Version:2026-07-16T17:57:57Z/373
2026-07-16T17:57:57.254562Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:57.254602Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:57:57.254602Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:57:57.254565Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:57:57.256159Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:30.5kB
2026-07-16T17:57:57.256280Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:30.5kB
2026-07-16T17:57:57.261427Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:58:02.475485Z	info	ads	Push debounce stable[692] 2 for config Secret/ai-tenant-e2e-shared-b-4816ad/rate-test-model-4816ad-kserve-self-signed-certs and 1 more configs: 100.900802ms since last change, 123.265103ms since last push, full=false
2026-07-16T17:58:02.475532Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:57:57Z/373
2026-07-16T17:58:16.248366Z	info	ads	Push debounce stable[693] 1 for config Secret/ai-tenant-e2e-shared-b-4816ad/rate-test-model-4816ad-kserve-self-signed-certs: 100.380891ms since last change, 100.38082ms since last push, full=false
2026-07-16T17:58:16.248416Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:57:57Z/373
2026-07-16T17:58:27.850532Z	info	ads	Push debounce stable[694] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4816ad: 100.884202ms since last change, 100.884134ms since last push, full=true
2026-07-16T17:58:27.869418Z	info	ads	XDS: Pushing Services:117 ConnectedEndpoints:4 Version:2026-07-16T17:58:27Z/374
2026-07-16T17:58:27.869763Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:58:27.869837Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:58:27.869856Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:27.869765Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:27.872795Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:30.5kB
2026-07-16T17:58:27.872986Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:31.8kB
2026-07-16T17:58:27.877521Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:58:27.953369Z	info	ads	Push debounce stable[695] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-6a2606: 101.005026ms since last change, 101.004954ms since last push, full=true
2026-07-16T17:58:27.965694Z	info	ads	XDS: Pushing Services:117 ConnectedEndpoints:4 Version:2026-07-16T17:58:27Z/375
2026-07-16T17:58:27.965962Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:27.965986Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:27.966100Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:58:27.965986Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:58:27.967390Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:31.8kB
2026-07-16T17:58:27.967542Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:31.8kB
2026-07-16T17:58:27.972364Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:58:43.113853Z	info	ads	Push debounce stable[696] 1 for config Secret/kube-system/argocd-manager-dockercfg-bjjbl: 100.205569ms since last change, 100.205485ms since last push, full=false
2026-07-16T17:58:43.113901Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:58:27Z/375
2026-07-16T17:58:44.740334Z	info	ads	Push debounce stable[697] 2 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4816ad and 1 more configs: 100.708212ms since last change, 197.62244ms since last push, full=true
2026-07-16T17:58:44.753053Z	info	ads	XDS: Pushing Services:117 ConnectedEndpoints:4 Version:2026-07-16T17:58:44Z/376
2026-07-16T17:58:44.753408Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:44.753457Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:44.753458Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:58:44.753408Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:58:44.754946Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:31.8kB
2026-07-16T17:58:44.756423Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:31.8kB
2026-07-16T17:58:44.760949Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:58:50.395531Z	info	model	Incremental push, service rate-test-model-6a2606-kserve-workload-svc.ai-tenant-e2e-shared-a-6a2606.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints
2026-07-16T17:58:50.399277Z	error	status	Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute ba71fded-74f7-4b73-9bd3-f252de7a4e2b rate-test-model-6a2606-kserve-route ai-tenant-e2e-shared-a-6a2606 cluster.local map[app.kubernetes.io/component:llminferenceservice-router app.kubernetes.io/name:rate-test-model-6a2606 app.kubernetes.io/part-of:llminferenceservice] map[] 55511 2026-07-16 17:57:25 +0000 UTC [{serving.kserve.io/v1alpha2 LLMInferenceService rate-test-model-6a2606 ce36e0aa-2620-409b-83b2-2fe6a38a9d46 0xc0055f9d6d 0xc0055f9d6c}] 1} 0xc003992108 0xc0012618c8 map[]}, will try again later: httproutes.gateway.networking.k8s.io "rate-test-model-6a2606-kserve-route" not found
2026-07-16T17:58:50.495645Z	info	ads	Push debounce stable[698] 6 for config Secret/ai-tenant-e2e-shared-a-6a2606/kserve-metrics-reader-sa-dockercfg-qs5x4 and 4 more configs: 100.053632ms since last change, 161.065838ms since last push, full=true
2026-07-16T17:58:50.496373Z	info	ads	XDS: Pushing Services:116 ConnectedEndpoints:4 Version:2026-07-16T17:58:50Z/377
2026-07-16T17:58:50.496844Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:58:50.496990Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:1 size:44B
2026-07-16T17:58:50.497006Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:58:50.497001Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:58:50.497639Z	info	delta	EDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:147 removed:0 size:35.5kB empty:1 cached:146/147
2026-07-16T17:58:50.497732Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:147 removed:0 size:35.5kB empty:1 cached:146/147
2026-07-16T17:58:50.497862Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:147 removed:0 size:35.5kB empty:1 cached:146/147
2026-07-16T17:58:50.497964Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:147 removed:0 size:35.5kB empty:1 cached:146/147
2026-07-16T17:58:50.497990Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:50.498050Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:50.498141Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:58:50.498185Z	info	delta	SDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:58:50.498188Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:58:50.498263Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:58:50.498339Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:58:50.498376Z	info	delta	SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1
2026-07-16T17:58:50.498538Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:12.8kB cached:0/0
2026-07-16T17:58:50.498568Z	info	delta	SDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:58:50.499025Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0
2026-07-16T17:58:50.499058Z	info	delta	SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:58:51.217135Z	info	model	Incremental push, service rate-test-model-4816ad-kserve-workload-svc.ai-tenant-e2e-shared-b-4816ad.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints
2026-07-16T17:58:51.220277Z	error	status	Encountered unexpected error updating status for &{{gateway.networking.k8s.io/v1beta1/HTTPRoute 0603e2e6-83ad-4de1-843a-f276559dcf5c rate-test-model-4816ad-kserve-route ai-tenant-e2e-shared-b-4816ad cluster.local map[app.kubernetes.io/component:llminferenceservice-router app.kubernetes.io/name:rate-test-model-4816ad app.kubernetes.io/part-of:llminferenceservice] map[] 55515 2026-07-16 17:57:51 +0000 UTC [{serving.kserve.io/v1alpha2 LLMInferenceService rate-test-model-4816ad 44af53f3-6a74-4f6b-958d-ff2e44023520 0xc004d81f77 0xc004d81f76}] 1} 0xc00610c408 0xc001256648 map[]}, will try again later: httproutes.gateway.networking.k8s.io "rate-test-model-4816ad-kserve-route" not found
2026-07-16T17:58:51.318096Z	info	ads	Push debounce stable[699] 6 for config ServiceEntry/ai-tenant-e2e-shared-b-4816ad/rate-test-model-4816ad-kserve-workload-svc.ai-tenant-e2e-shared-b-4816ad.svc.cluster.local and 4 more configs: 100.916437ms since last change, 167.443886ms since last push, full=true
2026-07-16T17:58:51.318790Z	info	ads	XDS: Pushing Services:115 ConnectedEndpoints:4 Version:2026-07-16T17:58:51Z/378
2026-07-16T17:58:51.319254Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:58:51.319325Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:58:51.319400Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:1 size:44B
2026-07-16T17:58:51.319512Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:3 removed:1 size:507B
2026-07-16T17:58:51.320124Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:146 removed:0 size:35.2kB empty:1 cached:145/146
2026-07-16T17:58:51.320184Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:146 removed:0 size:35.2kB empty:1 cached:145/146
2026-07-16T17:58:51.320136Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:146 removed:0 size:35.2kB empty:1 cached:145/146
2026-07-16T17:58:51.320356Z	info	delta	EDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:146 removed:0 size:35.2kB empty:1 cached:145/146
2026-07-16T17:58:51.320440Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:58:51.320477Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:51.320490Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:58:51.320546Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:51.320548Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:58:51.320676Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:58:51.320699Z	info	delta	SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1
2026-07-16T17:58:51.320715Z	info	delta	SDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:58:51.320879Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:3.8kB cached:0/0
2026-07-16T17:58:51.320908Z	info	delta	SDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:58:51.321633Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:51.7kB cached:0/0
2026-07-16T17:58:51.321668Z	info	delta	SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:58:53.740566Z	info	ads	Push debounce stable[700] 2 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4816ad and 1 more configs: 100.263818ms since last change, 186.280035ms since last push, full=true
2026-07-16T17:58:53.759795Z	info	ads	XDS: Pushing Services:115 ConnectedEndpoints:4 Version:2026-07-16T17:58:53Z/379
2026-07-16T17:58:53.760184Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:58:53.760186Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:53.760186Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:58:53.760187Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.6kB
2026-07-16T17:58:53.760926Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:8.4kB
2026-07-16T17:58:53.761934Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:30.5kB
2026-07-16T17:58:53.766832Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:58:58.117247Z	info	ads	Push debounce stable[701] 3 for config Secret/cert-manager-operator/default-dockercfg-8tl6s and 2 more configs: 100.342781ms since last change, 102.912968ms since last push, full=false
2026-07-16T17:58:58.117318Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:4 Version:2026-07-16T17:58:53Z/379
2026-07-16T17:59:02.807033Z	info	ads	Push debounce stable[702] 3 for config ServiceEntry/openshift-ingress/payload-processing.openshift-ingress.svc.cluster.local and 2 more configs: 100.779927ms since last change, 173.000016ms since last push, full=true
2026-07-16T17:59:02.808369Z	info	ads	XDS: Pushing Services:115 ConnectedEndpoints:4 Version:2026-07-16T17:59:02Z/380
2026-07-16T17:59:02.809783Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:148 removed:0 size:169.9kB cached:143/145
2026-07-16T17:59:02.809860Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:148 removed:0 size:169.9kB cached:143/145
2026-07-16T17:59:02.809881Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:148 removed:0 size:169.9kB cached:143/145
2026-07-16T17:59:02.809982Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:146 removed:0 size:169.4kB cached:143/145
2026-07-16T17:59:02.810760Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:145 removed:0 size:35.1kB empty:0 cached:144/145
2026-07-16T17:59:02.810864Z	info	delta	EDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:145 removed:0 size:35.1kB empty:0 cached:145/145
2026-07-16T17:59:02.811064Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:145 removed:0 size:35.1kB empty:0 cached:144/145
2026-07-16T17:59:02.811077Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:59:02.811081Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:59:02.811226Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:59:02.811233Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:145 removed:0 size:35.1kB empty:0 cached:145/145
2026-07-16T17:59:02.811226Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:59:02.811475Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:59:02.811488Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:59:02.811565Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:59:02.811873Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:8.4kB
2026-07-16T17:59:02.812541Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0
2026-07-16T17:59:02.812865Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:30.5kB
2026-07-16T17:59:02.818583Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:59:05.533734Z	info	ads	Push debounce stable[703] 1 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-b-4816ad: 100.209053ms since last change, 100.208976ms since last push, full=true
2026-07-16T17:59:05.543671Z	info	ads	XDS: Pushing Services:115 ConnectedEndpoints:4 Version:2026-07-16T17:59:05Z/381
2026-07-16T17:59:05.543980Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:59:05.544049Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:59:05.544054Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:59:05.544054Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:59:05.544568Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:8.4kB
2026-07-16T17:59:05.544663Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:8.4kB
2026-07-16T17:59:05.550613Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:59:16.634593Z	info	delta	ADS: "10.132.0.46:39830" maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress-3 terminated
2026-07-16T17:59:17.035094Z	info	ads	Push debounce stable[704] 1 for config ConfigMap/ai-tenant-e2e-shared-a-6a2606/kube-root-ca.crt: 100.910864ms since last change, 100.910773ms since last push, full=false
2026-07-16T17:59:17.035145Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-16T17:59:05Z/381
2026-07-16T17:59:17.075374Z	info	delta	ADS: new delta connection for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress-22
2026-07-16T17:59:17.076356Z	info	delta	CDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:148 removed:0 size:169.9kB cached:145/145 filtered:0
2026-07-16T17:59:17.077007Z	info	delta	EDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:145 removed:0 size:35.1kB empty:0 cached:145/145 filtered:0
2026-07-16T17:59:17.077273Z	info	delta	LDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB filtered:0
2026-07-16T17:59:17.077343Z	info	delta	SDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 filtered:0
2026-07-16T17:59:17.078678Z	info	delta	RDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0 filtered:0
2026-07-16T17:59:17.084869Z	info	delta	ECDS: PUSH request for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB filtered:0
2026-07-16T17:59:17.598210Z	info	ads	Push debounce stable[705] 4 for config Secret/ai-tenant-e2e-shared-a-6a2606/builder-dockercfg-wrskm and 3 more configs: 100.45848ms since last change, 160.165821ms since last push, full=true
2026-07-16T17:59:17.598318Z	info	ads	XDS: Pushing Services:115 ConnectedEndpoints:4 Version:2026-07-16T17:59:17Z/382
2026-07-16T17:59:17.598619Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:59:17.598619Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:59:17.598636Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:59:17.598620Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:59:17.598771Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:59:17.598830Z	info	delta	SDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:59:17.598754Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:59:17.598863Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:59:17.598886Z	info	delta	SDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:59:17.598895Z	info	delta	SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1
2026-07-16T17:59:17.599682Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0
2026-07-16T17:59:17.599722Z	info	delta	SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:59:17.777502Z	info	model	Incremental push, service e2e-shared-a-6a2606-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints
2026-07-16T17:59:17.884559Z	info	ads	Push debounce stable[706] 10 for config WasmPlugin/openshift-ingress/kuadrant-e2e-shared-a-6a2606 and 8 more configs: 100.89478ms since last change, 134.451122ms since last push, full=true
2026-07-16T17:59:17.895169Z	info	ads	XDS: Pushing Services:114 ConnectedEndpoints:4 Version:2026-07-16T17:59:17Z/383
2026-07-16T17:59:17.896240Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:144 removed:2 size:166.8kB cached:143/143
2026-07-16T17:59:17.896333Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:146 removed:2 size:167.2kB cached:143/143
2026-07-16T17:59:17.896539Z	info	delta	CDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:144 removed:4 size:166.8kB cached:143/143
2026-07-16T17:59:17.896658Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:146 removed:2 size:167.2kB cached:143/143
2026-07-16T17:59:17.897511Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:145 removed:0 size:34.7kB empty:2 cached:143/145
2026-07-16T17:59:17.898145Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:59:17.898313Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:59:17.898388Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:145 removed:0 size:34.7kB empty:2 cached:143/145
2026-07-16T17:59:17.898436Z	info	delta	SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1
2026-07-16T17:59:17.898482Z	info	delta	EDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:145 removed:0 size:34.7kB empty:2 cached:143/145
2026-07-16T17:59:17.898597Z	info	delta	LDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:0 removed:1 size:0B
2026-07-16T17:59:17.898656Z	warn	buildGatewayRoutes: no gateways for router e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress
2026-07-16T17:59:17.898748Z	info	delta	RDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:1 removed:0 size:97B cached:0/0
2026-07-16T17:59:17.898527Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:145 removed:0 size:34.7kB empty:2 cached:143/145
2026-07-16T17:59:17.898826Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:59:17.899004Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:59:17.898782Z	warn	ads	proxy e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress attempted to access unauthorized certificates e2e-shared-a-6a2606-gw-service-tls: cross namespace secret reference requires ReferenceGrant
2026-07-16T17:59:17.899088Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:59:17.899059Z	info	delta	SDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:59:17.899130Z	info	delta	ECDS: PUSH for node:e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress resources:0 removed:0 size:0B
2026-07-16T17:59:17.900272Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:8.4kB
2026-07-16T17:59:17.900922Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0
2026-07-16T17:59:17.901012Z	info	delta	SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:59:17.910460Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:59:22.805434Z	info	delta	ADS: "10.133.0.45:53224" e2e-shared-a-6a2606-openshift-default-687d65bd8c-975rk.openshift-ingress-19 terminated
2026-07-16T17:59:24.232232Z	info	ads	Push debounce stable[707] 4 for config ConfigMap/ai-tenant-e2e-shared-b-4816ad/kube-root-ca.crt and 3 more configs: 100.936767ms since last change, 134.886053ms since last push, full=false
2026-07-16T17:59:24.232277Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-16T17:59:17Z/383
2026-07-16T17:59:24.804702Z	info	ads	Push debounce stable[708] 1 for config Gateway/openshift-ingress/e2e-shared-b-4816ad-istio-autogenerated-k8s-gateway-https: 100.218967ms since last change, 100.21889ms since last push, full=true
2026-07-16T17:59:24.804844Z	info	ads	XDS: Pushing Services:114 ConnectedEndpoints:3 Version:2026-07-16T17:59:24Z/384
2026-07-16T17:59:24.805166Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:59:24.805176Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:59:24.805251Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:4.1kB
2026-07-16T17:59:24.805284Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:59:24.805357Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:2.8kB cached:0/0
2026-07-16T17:59:24.806193Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0
2026-07-16T17:59:25.000188Z	info	model	Incremental push, service e2e-shared-b-4816ad-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints
2026-07-16T17:59:25.112280Z	info	ads	Push debounce stable[709] 10 for config Gateway/openshift-ingress/e2e-shared-b-4816ad-istio-autogenerated-k8s-gateway-https and 8 more configs: 100.509517ms since last change, 140.501245ms since last push, full=true
2026-07-16T17:59:25.121860Z	info	ads	XDS: Pushing Services:113 ConnectedEndpoints:3 Version:2026-07-16T17:59:25Z/385
2026-07-16T17:59:25.122787Z	info	delta	CDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:142 removed:2 size:164.1kB cached:141/141
2026-07-16T17:59:25.122964Z	info	delta	CDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:144 removed:2 size:164.6kB cached:141/141
2026-07-16T17:59:25.123067Z	info	delta	CDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:142 removed:4 size:164.1kB cached:141/141
2026-07-16T17:59:25.123378Z	info	delta	EDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:143 removed:0 size:34.1kB empty:2 cached:141/143
2026-07-16T17:59:25.123627Z	info	delta	LDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:7.2kB
2026-07-16T17:59:25.123710Z	info	delta	EDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:143 removed:0 size:34.1kB empty:2 cached:141/143
2026-07-16T17:59:25.123725Z	info	delta	RDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:732B cached:0/0
2026-07-16T17:59:25.123765Z	info	delta	SDS: PUSH for node:data-science-gateway-data-science-gateway-class-7f964fb678rjhbr.openshift-ingress resources:1 removed:0 size:4.6kB cached:1/1
2026-07-16T17:59:25.123951Z	info	delta	LDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB
2026-07-16T17:59:25.124262Z	info	delta	EDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:143 removed:0 size:34.1kB empty:2 cached:141/143
2026-07-16T17:59:25.124300Z	info	delta	LDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:0 removed:1 size:0B
2026-07-16T17:59:25.124311Z	warn	buildGatewayRoutes: no gateways for router e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress
2026-07-16T17:59:25.124332Z	info	delta	RDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:1 removed:0 size:97B cached:0/0
2026-07-16T17:59:25.124354Z	warn	ads	proxy e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress attempted to access unauthorized certificates e2e-shared-b-4816ad-gw-service-tls: cross namespace secret reference requires ReferenceGrant
2026-07-16T17:59:25.124382Z	info	delta	ECDS: PUSH for node:e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress resources:0 removed:0 size:0B
2026-07-16T17:59:25.124923Z	info	delta	RDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:52.6kB cached:0/0
2026-07-16T17:59:25.124953Z	info	delta	SDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1
2026-07-16T17:59:25.130906Z	info	delta	ECDS: PUSH for node:maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress resources:1 removed:0 size:135.6kB
2026-07-16T17:59:26.116483Z	info	ads	Push debounce stable[710] 1 for config Secret/cert-manager-operator/cert-manager-operator-controller-manager-dockercfg-c5jqw: 100.199872ms since last change, 100.199798ms since last push, full=false
2026-07-16T17:59:26.116539Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:3 Version:2026-07-16T17:59:25Z/385
2026-07-16T17:59:26.116638Z	warn	ads	proxy e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress attempted to access unauthorized certificates e2e-shared-b-4816ad-gw-service-tls: cross namespace secret reference requires ReferenceGrant
2026-07-16T17:59:26.838714Z	info	ads	Push Status: {
    "pilot_duplicate_envoy_clusters": {
        "kuadrant-auth-service": {
            "proxy": "maas-default-gateway-openshift-default-5896d4dd49-f494m.openshift-ingress",
            "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS"
        }
    }
}
2026-07-16T17:59:30.031634Z	info	delta	ADS: "10.133.0.46:50520" e2e-shared-b-4816ad-openshift-default-76855d75bc-xsbcc.openshift-ingress-20 terminated
2026-07-16T17:59:30.133643Z	info	ads	Push debounce stable[711] 7 for config Secret/cert-manager/builder-dockercfg-lg9cq and 6 more configs: 100.260617ms since last change, 117.035239ms since last push, full=false
2026-07-16T17:59:30.133696Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-16T17:59:25Z/385
2026-07-16T17:59:32.118544Z	info	ads	Push debounce stable[712] 1 for config Secret/cert-manager/cert-manager-cainjector-dockercfg-vkhgc: 100.204816ms since last change, 100.204736ms since last push, full=false
2026-07-16T17:59:32.118601Z	info	ads	XDS: Incremental Pushing ConnectedEndpoints:2 Version:2026-07-16T17:59:25Z/385