2026-11-04T02:02:04.980729Z info ads XDS: Pushing Services:131 ConnectedEndpoints:1 Version:2026-11-04T02:02:04Z/157 2026-11-04T02:02:04.981536Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:8 removed:0 size:3.4kB cached:0/1 2026-11-04T02:02:04.981716Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:733B empty:0 cached:0/1 2026-11-04T02:02:04.982290Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:04.982515Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:06.637138Z info ads Push debounce stable[215] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.65494ms since last change, 100.654876ms since last push, full=true 2026-11-04T02:02:06.637918Z info ads XDS: Pushing Services:131 ConnectedEndpoints:1 Version:2026-11-04T02:02:06Z/158 2026-11-04T02:02:06.638844Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:8 removed:0 size:3.4kB cached:0/1 2026-11-04T02:02:06.638999Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:733B empty:0 cached:0/1 2026-11-04T02:02:06.639619Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:06.640130Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:07.739849Z info ads Push debounce stable[216] 1 for config Gateway/openshift-ingress/e2e-extmod-b-fa5570~istio-autogenerated-k8s-gateway~https: 100.632439ms since last change, 100.632359ms since last push, full=true 2026-11-04T02:02:07.740014Z info ads XDS: Pushing Services:131 ConnectedEndpoints:1 Version:2026-11-04T02:02:07Z/159 2026-11-04T02:02:07.740525Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:07.740846Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:08.105776Z info model Incremental push, service maas-api-e2e-extmod-a-219ce6.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:08.351262Z info ads Push debounce stable[217] 7 for config DestinationRule/openshift-ingress/maas-api-backend-tls-e2e-extmod-a-219ce6 and 5 more configs: 101.065915ms since last change, 267.812932ms since last push, full=true 2026-11-04T02:02:08.352084Z info ads XDS: Pushing Services:130 ConnectedEndpoints:1 Version:2026-11-04T02:02:08Z/160 2026-11-04T02:02:08.352717Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:8 removed:1 size:3.4kB cached:0/1 2026-11-04T02:02:08.353794Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:166 removed:0 size:45.6kB empty:1 cached:164/166 2026-11-04T02:02:08.355947Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:08.356420Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:08.356517Z info delta SDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-11-04T02:02:08.660968Z info ads Push debounce stable[218] 3 for config EnvoyFilter/openshift-ingress/maas-model-access-logs-e2e-extmod-a-219ce6 and 2 more configs: 100.407003ms since last change, 201.121615ms since last push, full=true 2026-11-04T02:02:08.661785Z info ads XDS: Pushing Services:130 ConnectedEndpoints:1 Version:2026-11-04T02:02:08Z/161 2026-11-04T02:02:08.663047Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:172 removed:0 size:196.6kB cached:164/165 2026-11-04T02:02:08.663643Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:165 removed:0 size:45.5kB empty:0 cached:164/165 2026-11-04T02:02:08.664057Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:08.664276Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:09.037001Z info model Incremental push, service e2e-extmod-b-fa5570-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:09.142199Z info ads Push debounce stable[219] 7 for config Secret/openshift-ingress/e2e-extmod-b-fa5570-gw-service-tls and 5 more configs: 100.627439ms since last change, 163.210097ms since last push, full=true 2026-11-04T02:02:09.143029Z info ads XDS: Pushing Services:129 ConnectedEndpoints:1 Version:2026-11-04T02:02:09Z/162 2026-11-04T02:02:09.144233Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:170 removed:2 size:194.0kB cached:162/163 2026-11-04T02:02:09.145245Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:165 removed:0 size:45.1kB empty:2 cached:162/165 2026-11-04T02:02:09.145823Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:09.146252Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:09.146288Z info delta SDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-11-04T02:02:10.911268Z info ads Push debounce stable[220] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.10172ms since last change, 100.101661ms since last push, full=true 2026-11-04T02:02:10.912028Z info ads XDS: Pushing Services:129 ConnectedEndpoints:1 Version:2026-11-04T02:02:10Z/163 2026-11-04T02:02:10.912786Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:8 removed:0 size:3.4kB cached:0/1 2026-11-04T02:02:10.912913Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:604B empty:0 cached:0/1 2026-11-04T02:02:10.913340Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:10.913590Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:11.999038Z info ads Push debounce stable[221] 1 for config Gateway/openshift-ingress/e2e-extmod-a-219ce6~istio-autogenerated-k8s-gateway~https: 100.08069ms since last change, 100.080551ms since last push, full=true 2026-11-04T02:02:11.999193Z info ads XDS: Pushing Services:129 ConnectedEndpoints:1 Version:2026-11-04T02:02:11Z/164 2026-11-04T02:02:11.999774Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:12.000078Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:12.970003Z info ads Push debounce stable[222] 4 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-extmod-a-219ce6 and 3 more configs: 100.048389ms since last change, 205.712377ms since last push, full=true 2026-11-04T02:02:12.971185Z info ads XDS: Pushing Services:129 ConnectedEndpoints:1 Version:2026-11-04T02:02:12Z/165 2026-11-04T02:02:12.972930Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:170 removed:0 size:194.0kB cached:162/163 2026-11-04T02:02:12.973836Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:163 removed:0 size:44.9kB empty:0 cached:162/163 2026-11-04T02:02:12.974392Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:12.974722Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:13.141527Z info ads Push debounce stable[223] 1 for config EnvoyFilter/openshift-ingress/kuadrant-e2e-extmod-a-219ce6: 100.040367ms since last change, 100.040291ms since last push, full=true 2026-11-04T02:02:13.141737Z info ads XDS: Pushing Services:129 ConnectedEndpoints:1 Version:2026-11-04T02:02:13Z/166 2026-11-04T02:02:13.142731Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:170 removed:0 size:194.0kB cached:163/163 2026-11-04T02:02:13.143335Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:163 removed:0 size:44.9kB empty:0 cached:163/163 2026-11-04T02:02:13.143736Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:13.143970Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:13.354283Z info model Incremental push, service e2e-extmod-a-219ce6-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:13.454740Z info ads Push debounce stable[224] 6 for config Secret/openshift-ingress/e2e-extmod-a-219ce6-openshift-default-dockercfg-2qxcq and 4 more configs: 100.388921ms since last change, 148.733551ms since last push, full=true 2026-11-04T02:02:13.455969Z info ads XDS: Pushing Services:128 ConnectedEndpoints:1 Version:2026-11-04T02:02:13Z/167 2026-11-04T02:02:13.458167Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:168 removed:2 size:191.4kB cached:161/161 2026-11-04T02:02:13.459137Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:163 removed:0 size:44.5kB empty:2 cached:161/163 2026-11-04T02:02:13.459944Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:13.460384Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:13.460482Z info delta SDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-11-04T02:02:14.754575Z info ads Push debounce stable[225] 5 for config ServiceEntry/e2e-models-e2e-worker-w0-2f5e19/simulator-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local and 4 more configs: 100.904427ms since last change, 171.012847ms since last push, full=true 2026-11-04T02:02:14.755525Z info ads XDS: Pushing Services:128 ConnectedEndpoints:1 Version:2026-11-04T02:02:14Z/168 2026-11-04T02:02:14.756290Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:12 removed:0 size:8.3kB cached:0/5 2026-11-04T02:02:14.756447Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:5 removed:0 size:1.0kB empty:4 cached:0/5 2026-11-04T02:02:14.756906Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:14.757214Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:16.458278Z info ads Push debounce stable[226] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.608413ms since last change, 100.608334ms since last push, full=true 2026-11-04T02:02:16.459075Z info ads XDS: Pushing Services:128 ConnectedEndpoints:1 Version:2026-11-04T02:02:16Z/169 2026-11-04T02:02:16.459741Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:8 removed:0 size:3.4kB cached:0/1 2026-11-04T02:02:16.459876Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:604B empty:0 cached:0/1 2026-11-04T02:02:16.460309Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:16.460706Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:17.796072Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-11-04T02:02:18.259410Z info ads Push debounce stable[227] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.381215ms since last change, 100.381023ms since last push, full=true 2026-11-04T02:02:18.260375Z info ads XDS: Pushing Services:128 ConnectedEndpoints:1 Version:2026-11-04T02:02:18Z/170 2026-11-04T02:02:18.261286Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:8 removed:0 size:3.4kB cached:0/1 2026-11-04T02:02:18.261436Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:604B empty:0 cached:0/1 2026-11-04T02:02:18.262083Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:18.262523Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:19.881770Z info ads Push debounce stable[228] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.577646ms since last change, 100.577539ms since last push, full=true 2026-11-04T02:02:19.882729Z info ads XDS: Pushing Services:128 ConnectedEndpoints:1 Version:2026-11-04T02:02:19Z/171 2026-11-04T02:02:19.883470Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:8 removed:0 size:3.4kB cached:0/1 2026-11-04T02:02:19.883638Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:604B empty:0 cached:0/1 2026-11-04T02:02:19.884387Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:19.884720Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:20.291233Z info ads Push debounce stable[229] 4 for config EnvoyFilter/openshift-ingress/kuadrant-e2e-worker-w0-2f5e19 and 3 more configs: 100.214421ms since last change, 148.189272ms since last push, full=true 2026-11-04T02:02:20.306660Z info ads XDS: Pushing Services:128 ConnectedEndpoints:1 Version:2026-11-04T02:02:20Z/172 2026-11-04T02:02:20.307715Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:168 removed:0 size:191.4kB cached:161/161 2026-11-04T02:02:20.308435Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:161 removed:0 size:43.6kB empty:0 cached:161/161 2026-11-04T02:02:20.308877Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:20.309171Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:20.309211Z info delta SDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-11-04T02:02:20.733625Z info ads Push debounce stable[230] 3 for config Secret/ai-tenant-e2e-worker-w0-2f5e19/builder-dockercfg-zkh62 and 2 more configs: 100.22212ms since last change, 107.799051ms since last push, full=false 2026-11-04T02:02:20.733745Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:20Z/172 2026-11-04T02:02:21.469098Z info ads Push debounce stable[231] 1 for config ConfigMap/ai-tenant-e2e-worker-w0-2f5e19/kube-root-ca.crt: 101.045335ms since last change, 101.045258ms since last push, full=false 2026-11-04T02:02:21.469171Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:20Z/172 2026-11-04T02:02:21.602380Z info ads Push debounce stable[232] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.053168ms since last change, 100.053105ms since last push, full=true 2026-11-04T02:02:21.603148Z info ads XDS: Pushing Services:128 ConnectedEndpoints:1 Version:2026-11-04T02:02:21Z/173 2026-11-04T02:02:21.603799Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:8 removed:0 size:3.4kB cached:0/1 2026-11-04T02:02:21.603928Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:604B empty:0 cached:0/1 2026-11-04T02:02:21.604353Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:21.604709Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:22.062452Z info model Incremental push, service payload-processing-e2e-extmod-b-a393d3.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:22.108196Z info model Incremental push, service payload-pre-processing-e2e-extmod-b-a393d3.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:22.209037Z info ads Push debounce stable[233] 6 for config ServiceEntry/openshift-ingress/payload-processing-e2e-extmod-b-a393d3.openshift-ingress.svc.cluster.local and 1 more configs: 100.7795ms since last change, 241.051237ms since last push, full=true 2026-11-04T02:02:22.209744Z info ads XDS: Pushing Services:126 ConnectedEndpoints:1 Version:2026-11-04T02:02:22Z/174 2026-11-04T02:02:22.210339Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:7 removed:2 size:2.1kB 2026-11-04T02:02:22.210403Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:0 removed:2 size:0B empty:0 cached:0/0 2026-11-04T02:02:22.210899Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:25.0kB 2026-11-04T02:02:22.211177Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:5.1kB cached:0/0 2026-11-04T02:02:22.358165Z info ads Push debounce stable[234] 1 for config Secret/openshift-ingress/payload-processing-e2e-extmod-b-a393d3-dockercfg-pnzzd: 100.210646ms since last change, 100.210369ms since last push, full=false 2026-11-04T02:02:22.358237Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:22Z/174 2026-11-04T02:02:22.630882Z info ads Push debounce stable[235] 4 for config ConfigMap/ai-tenant-e2e-extmod-b-a393d3/kube-root-ca.crt and 3 more configs: 101.031863ms since last change, 262.598742ms since last push, full=true 2026-11-04T02:02:22.631209Z info ads XDS: Pushing Services:126 ConnectedEndpoints:1 Version:2026-11-04T02:02:22Z/175 2026-11-04T02:02:22.636085Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:164 removed:2 size:187.8kB cached:0/159 2026-11-04T02:02:22.636946Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:159 removed:0 size:43.0kB empty:0 cached:159/159 2026-11-04T02:02:22.637478Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:24.4kB 2026-11-04T02:02:22.637719Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:4.1kB cached:0/0 2026-11-04T02:02:22.637773Z info delta SDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-11-04T02:02:22.992758Z info model Incremental push, service payload-processing-e2e-worker-w0-2f5e19.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:23.040182Z info model Incremental push, service payload-pre-processing-e2e-worker-w0-2f5e19.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:23.140891Z info ads Push debounce stable[236] 6 for config ServiceEntry/openshift-ingress/payload-processing-e2e-worker-w0-2f5e19.openshift-ingress.svc.cluster.local and 1 more configs: 100.661056ms since last change, 248.518504ms since last push, full=true 2026-11-04T02:02:23.141568Z info ads XDS: Pushing Services:124 ConnectedEndpoints:1 Version:2026-11-04T02:02:23Z/176 2026-11-04T02:02:23.142184Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:5 removed:2 size:1.0kB 2026-11-04T02:02:23.142241Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:0 removed:2 size:0B empty:0 cached:0/0 2026-11-04T02:02:23.142599Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:24.4kB 2026-11-04T02:02:23.142793Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:4.1kB cached:0/0 2026-11-04T02:02:23.311392Z info ads Push debounce stable[237] 1 for config Secret/openshift-ingress/payload-processing-e2e-worker-w0-2f5e19-dockercfg-dhgqp: 100.222453ms since last change, 100.222369ms since last push, full=false 2026-11-04T02:02:23.311446Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:23Z/176 2026-11-04T02:02:23.595262Z info ads Push debounce stable[238] 4 for config DestinationRule/openshift-ingress/payload-processing-e2e-worker-w0-2f5e19 and 3 more configs: 100.240312ms since last change, 233.007762ms since last push, full=true 2026-11-04T02:02:23.596131Z info ads XDS: Pushing Services:124 ConnectedEndpoints:1 Version:2026-11-04T02:02:23Z/177 2026-11-04T02:02:23.597305Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:162 removed:0 size:185.2kB cached:156/157 2026-11-04T02:02:23.598092Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:157 removed:0 size:42.5kB empty:0 cached:156/157 2026-11-04T02:02:23.598475Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:24.4kB 2026-11-04T02:02:23.598641Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:4.1kB cached:0/0 2026-11-04T02:02:25.058344Z info model Incremental push, service maas-api-e2e-extmod-b-a393d3.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:25.271760Z info ads Push debounce stable[239] 7 for config VirtualService/odh-ai-gateway-infra/openshift-ingress~e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https~* and 5 more configs: 100.801761ms since last change, 222.471338ms since last push, full=true 2026-11-04T02:02:25.273460Z info ads XDS: Pushing Services:123 ConnectedEndpoints:1 Version:2026-11-04T02:02:25Z/178 2026-11-04T02:02:25.277885Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:6 removed:1 size:2.4kB cached:0/1 2026-11-04T02:02:25.280092Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:157 removed:0 size:42.2kB empty:1 cached:155/157 2026-11-04T02:02:25.280889Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:24.2kB 2026-11-04T02:02:25.280998Z warn constructed http route config for route https.443.default.e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:25.281059Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-11-04T02:02:25.281121Z info delta SDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-11-04T02:02:25.488143Z info ads Push debounce stable[240] 2 for config EnvoyFilter/openshift-ingress/maas-model-access-logs-e2e-extmod-b-a393d3 and 1 more configs: 100.067236ms since last change, 192.84143ms since last push, full=true 2026-11-04T02:02:25.488934Z info ads XDS: Pushing Services:123 ConnectedEndpoints:1 Version:2026-11-04T02:02:25Z/179 2026-11-04T02:02:25.493977Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:160 removed:1 size:183.6kB cached:0/156 2026-11-04T02:02:25.495093Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:156 removed:0 size:42.1kB empty:0 cached:155/156 2026-11-04T02:02:25.495446Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:18.0kB 2026-11-04T02:02:25.495493Z warn constructed http route config for route https.443.default.e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:25.495531Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-11-04T02:02:25.798027Z info ads Push debounce stable[241] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.920342ms since last change, 100.920256ms since last push, full=true 2026-11-04T02:02:25.798726Z info ads XDS: Pushing Services:123 ConnectedEndpoints:1 Version:2026-11-04T02:02:25Z/180 2026-11-04T02:02:25.799319Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-11-04T02:02:25.799467Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:475B empty:0 cached:0/1 2026-11-04T02:02:25.799741Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:18.0kB 2026-11-04T02:02:25.799767Z warn constructed http route config for route https.443.default.e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:25.799788Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-11-04T02:02:25.952091Z info ads Push debounce stable[242] 1 for config EnvoyFilter/openshift-ingress/kuadrant-e2e-extmod-b-a393d3: 100.252255ms since last change, 100.252114ms since last push, full=true 2026-11-04T02:02:25.954109Z info ads XDS: Pushing Services:123 ConnectedEndpoints:1 Version:2026-11-04T02:02:25Z/181 2026-11-04T02:02:25.959393Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:160 removed:0 size:183.6kB cached:0/156 2026-11-04T02:02:25.960434Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:156 removed:0 size:42.1kB empty:0 cached:156/156 2026-11-04T02:02:25.961106Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:17.4kB 2026-11-04T02:02:25.961290Z warn constructed http route config for route https.443.default.e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:25.961439Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-11-04T02:02:27.795668Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-11-04T02:02:27.987495Z info ads Push debounce stable[243] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.352386ms since last change, 100.352293ms since last push, full=true 2026-11-04T02:02:27.988246Z info ads XDS: Pushing Services:123 ConnectedEndpoints:1 Version:2026-11-04T02:02:27Z/182 2026-11-04T02:02:27.988918Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-11-04T02:02:27.989060Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:475B empty:0 cached:0/1 2026-11-04T02:02:27.989344Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:17.4kB 2026-11-04T02:02:27.989382Z warn constructed http route config for route https.443.default.e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:27.989418Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-11-04T02:02:29.784140Z info ads Push debounce stable[244] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.562374ms since last change, 100.562268ms since last push, full=true 2026-11-04T02:02:29.785122Z info ads XDS: Pushing Services:123 ConnectedEndpoints:1 Version:2026-11-04T02:02:29Z/183 2026-11-04T02:02:29.786992Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-11-04T02:02:29.787159Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:475B empty:0 cached:0/1 2026-11-04T02:02:29.787482Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:17.4kB 2026-11-04T02:02:29.787521Z warn constructed http route config for route https.443.default.e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:29.787550Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-11-04T02:02:29.946724Z info model Incremental push, service premium-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:29.973319Z info model Incremental push, service distinct-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:30.026212Z info model Incremental push, service simulator-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:30.081308Z info model Incremental push, service distinct-2-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:30.181383Z info ads Push debounce stable[245] 4 for config ServiceEntry/e2e-models-e2e-worker-w0-2f5e19/premium-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local and 3 more configs: 100.026771ms since last change, 234.611579ms since last push, full=false 2026-11-04T02:02:30.181453Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:29Z/183 2026-11-04T02:02:30.775456Z info ads Push debounce stable[246] 1 for config Gateway/openshift-ingress/e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https: 100.760667ms since last change, 100.760596ms since last push, full=true 2026-11-04T02:02:30.775600Z info ads XDS: Pushing Services:123 ConnectedEndpoints:1 Version:2026-11-04T02:02:30Z/184 2026-11-04T02:02:30.775988Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:17.4kB 2026-11-04T02:02:30.776024Z warn constructed http route config for route https.443.default.e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:30.776046Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-11-04T02:02:31.564551Z info ads Push debounce stable[247] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.270752ms since last change, 100.270675ms since last push, full=true 2026-11-04T02:02:31.565297Z info ads XDS: Pushing Services:123 ConnectedEndpoints:1 Version:2026-11-04T02:02:31Z/185 2026-11-04T02:02:31.566001Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-11-04T02:02:31.566166Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:475B empty:0 cached:0/1 2026-11-04T02:02:31.566469Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:17.4kB 2026-11-04T02:02:31.566502Z warn constructed http route config for route https.443.default.e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:31.566530Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-11-04T02:02:31.676521Z info ads Push debounce stable[248] 1 for config Gateway/openshift-ingress/e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https: 100.228755ms since last change, 100.228679ms since last push, full=true 2026-11-04T02:02:31.676715Z info ads XDS: Pushing Services:123 ConnectedEndpoints:1 Version:2026-11-04T02:02:31Z/186 2026-11-04T02:02:31.677100Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:17.4kB 2026-11-04T02:02:31.677134Z warn constructed http route config for route https.443.default.e2e-extmod-b-a393d3~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:31.677156Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:125B cached:0/0 2026-11-04T02:02:32.033261Z info model Incremental push, service e2e-extmod-b-a393d3-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:32.136703Z info ads Push debounce stable[249] 9 for config Secret/openshift-ingress/e2e-extmod-b-a393d3-openshift-default-dockercfg-v4rq9 and 7 more configs: 100.470063ms since last change, 141.872037ms since last push, full=true 2026-11-04T02:02:32.137513Z info ads XDS: Pushing Services:122 ConnectedEndpoints:1 Version:2026-11-04T02:02:32Z/187 2026-11-04T02:02:32.142317Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:155 removed:5 size:180.4kB cached:0/154 2026-11-04T02:02:32.142930Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:156 removed:0 size:41.7kB empty:2 cached:154/156 2026-11-04T02:02:32.143042Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:0 removed:1 size:0B 2026-11-04T02:02:32.143090Z warn buildGatewayRoutes: no gateways for router e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress 2026-11-04T02:02:32.143126Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-11-04T02:02:32.143147Z warn ads proxy e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress attempted to access unauthorized certificates e2e-extmod-b-a393d3-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-11-04T02:02:33.569796Z info ads Push debounce stable[250] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.500526ms since last change, 100.500454ms since last push, full=true 2026-11-04T02:02:33.570496Z info ads XDS: Pushing Services:122 ConnectedEndpoints:1 Version:2026-11-04T02:02:33Z/188 2026-11-04T02:02:33.571027Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-11-04T02:02:33.571142Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:475B empty:0 cached:0/1 2026-11-04T02:02:33.571175Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:0 removed:0 size:0B 2026-11-04T02:02:33.571189Z warn buildGatewayRoutes: no gateways for router e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress 2026-11-04T02:02:33.571203Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-11-04T02:02:35.258874Z info ads Push debounce stable[251] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.064727ms since last change, 100.064661ms since last push, full=true 2026-11-04T02:02:35.259523Z info ads XDS: Pushing Services:122 ConnectedEndpoints:1 Version:2026-11-04T02:02:35Z/189 2026-11-04T02:02:35.260056Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-11-04T02:02:35.260162Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:475B empty:0 cached:0/1 2026-11-04T02:02:35.260192Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:0 removed:0 size:0B 2026-11-04T02:02:35.260206Z warn buildGatewayRoutes: no gateways for router e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress 2026-11-04T02:02:35.260220Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-11-04T02:02:36.392499Z info ads Push debounce stable[252] 1 for config EnvoyFilter/openshift-ingress/kuadrant-e2e-worker-w0-2f5e19: 100.221036ms since last change, 100.22097ms since last push, full=true 2026-11-04T02:02:36.413037Z info ads XDS: Pushing Services:122 ConnectedEndpoints:1 Version:2026-11-04T02:02:36Z/190 2026-11-04T02:02:36.414339Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:155 removed:0 size:180.4kB cached:153/154 2026-11-04T02:02:36.415353Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:156 removed:0 size:41.7kB empty:2 cached:153/156 2026-11-04T02:02:36.415493Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:0 removed:0 size:0B 2026-11-04T02:02:36.415574Z warn buildGatewayRoutes: no gateways for router e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress 2026-11-04T02:02:36.415617Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-11-04T02:02:36.876659Z info ads Push debounce stable[253] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.506912ms since last change, 100.506844ms since last push, full=true 2026-11-04T02:02:36.877557Z info ads XDS: Pushing Services:122 ConnectedEndpoints:1 Version:2026-11-04T02:02:36Z/191 2026-11-04T02:02:36.878307Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-11-04T02:02:36.878454Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:475B empty:0 cached:0/1 2026-11-04T02:02:36.878505Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:0 removed:0 size:0B 2026-11-04T02:02:36.878524Z warn buildGatewayRoutes: no gateways for router e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress 2026-11-04T02:02:36.878548Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-11-04T02:02:37.830418Z info ads Push debounce stable[254] 2 for config ServiceEntry/e2e-models-e2e-worker-w2-65afc0/premium-w2-65afc0-kserve-workload-svc.e2e-models-e2e-worker-w2-65afc0.svc.cluster.local and 1 more configs: 100.927486ms since last change, 114.598255ms since last push, full=false 2026-11-04T02:02:37.830476Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:36Z/191 2026-11-04T02:02:38.468336Z info ads Push debounce stable[255] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.339381ms since last change, 100.339301ms since last push, full=true 2026-11-04T02:02:38.469055Z info ads XDS: Pushing Services:122 ConnectedEndpoints:1 Version:2026-11-04T02:02:38Z/192 2026-11-04T02:02:38.469647Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-11-04T02:02:38.469831Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:475B empty:0 cached:0/1 2026-11-04T02:02:38.469870Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:0 removed:0 size:0B 2026-11-04T02:02:38.469884Z warn buildGatewayRoutes: no gateways for router e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress 2026-11-04T02:02:38.469900Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-11-04T02:02:38.814026Z info delta ADS: new delta connection for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress-6 2026-11-04T02:02:38.818309Z info delta CDS: PUSH request for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:159 removed:0 size:181.4kB cached:0/154 2026-11-04T02:02:38.911992Z info delta EDS: PUSH request for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:154 removed:0 size:41.2kB empty:0 cached:154/154 filtered:0 2026-11-04T02:02:38.960908Z info delta LDS: PUSH request for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:190.1kB 2026-11-04T02:02:38.993128Z info delta RDS: PUSH request for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:63.3kB cached:0/0 filtered:0 2026-11-04T02:02:38.993288Z info delta SDS: PUSH request for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:4.5kB cached:0/1 filtered:0 2026-11-04T02:02:40.272905Z info ads Push debounce stable[256] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.250067ms since last change, 100.249995ms since last push, full=true 2026-11-04T02:02:40.273560Z info ads XDS: Pushing Services:122 ConnectedEndpoints:2 Version:2026-11-04T02:02:40Z/193 2026-11-04T02:02:40.274197Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:2 removed:0 size:1.4kB cached:0/1 2026-11-04T02:02:40.274205Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:6 removed:0 size:2.4kB cached:0/1 2026-11-04T02:02:40.274298Z info delta EDS: PUSH INC for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:475B empty:0 cached:0/1 2026-11-04T02:02:40.274320Z info delta EDS: PUSH INC for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:475B empty:0 cached:0/1 2026-11-04T02:02:40.274330Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:0 removed:0 size:0B 2026-11-04T02:02:40.274342Z warn buildGatewayRoutes: no gateways for router e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress 2026-11-04T02:02:40.274357Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-11-04T02:02:40.275008Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:190.1kB 2026-11-04T02:02:40.275873Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:63.3kB cached:0/0 2026-11-04T02:02:41.641858Z info model Incremental push, service maas-api-e2e-worker-w0-2f5e19.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:41.853604Z info ads Push debounce stable[257] 7 for config ServiceEntry/odh-ai-gateway-infra/maas-api-e2e-worker-w0-2f5e19.odh-ai-gateway-infra.svc.cluster.local and 6 more configs: 100.691116ms since last change, 216.585022ms since last push, full=true 2026-11-04T02:02:41.854625Z info ads XDS: Pushing Services:121 ConnectedEndpoints:2 Version:2026-11-04T02:02:41Z/194 2026-11-04T02:02:41.857551Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:2 removed:1 size:1.4kB cached:0/1 2026-11-04T02:02:41.857551Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:6 removed:1 size:2.4kB cached:0/1 2026-11-04T02:02:41.858699Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:154 removed:0 size:40.9kB empty:1 cached:151/154 2026-11-04T02:02:41.858701Z info delta EDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:156 removed:0 size:41.1kB empty:3 cached:151/156 2026-11-04T02:02:41.858980Z info delta LDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:0 removed:0 size:0B 2026-11-04T02:02:41.859033Z warn buildGatewayRoutes: no gateways for router e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress 2026-11-04T02:02:41.859242Z info delta RDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:1 removed:0 size:97B cached:0/0 2026-11-04T02:02:41.859302Z warn ads proxy e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress attempted to access unauthorized certificates e2e-extmod-b-a393d3-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-11-04T02:02:41.859506Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:189.8kB 2026-11-04T02:02:41.868601Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:41.868899Z info delta SDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:4.5kB cached:0/1 2026-11-04T02:02:42.050139Z info ads Push debounce stable[258] 2 for config EnvoyFilter/openshift-ingress/maas-model-access-logs-e2e-worker-w0-2f5e19 and 1 more configs: 100.085699ms since last change, 165.975679ms since last push, full=true 2026-11-04T02:02:42.050923Z info ads XDS: Pushing Services:121 ConnectedEndpoints:2 Version:2026-11-04T02:02:42Z/195 2026-11-04T02:02:42.052712Z info delta CDS: PUSH for node:e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress resources:154 removed:0 size:179.2kB cached:148/153 2026-11-04T02:02:42.059067Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:157 removed:1 size:179.8kB cached:0/153 2026-11-04T02:02:42.059952Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:154 removed:0 size:40.9kB empty:1 cached:153/154 2026-11-04T02:02:42.060454Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:183.6kB 2026-11-04T02:02:42.061849Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:42.370745Z info ads Push debounce stable[259] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.464161ms since last change, 100.464046ms since last push, full=true 2026-11-04T02:02:42.371434Z info ads XDS: Pushing Services:121 ConnectedEndpoints:2 Version:2026-11-04T02:02:42Z/196 2026-11-04T02:02:42.372162Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-11-04T02:02:42.372285Z info delta EDS: PUSH INC for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:344B empty:0 cached:0/1 2026-11-04T02:02:42.372857Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:183.6kB 2026-11-04T02:02:42.373860Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:42.421034Z info delta ADS: "10.133.0.62:38482" e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress-3 terminated 2026-11-04T02:02:42.421089Z info ads Client closed connection e2e-extmod-b-a393d3-openshift-default-7d9b5d6885-kqww6.openshift-ingress-3 2026-11-04T02:02:42.922779Z info ads Push debounce stable[260] 1 for config EnvoyFilter/openshift-ingress/kuadrant-e2e-worker-w2-65afc0: 100.73638ms since last change, 100.736312ms since last push, full=true 2026-11-04T02:02:42.937267Z info ads XDS: Pushing Services:121 ConnectedEndpoints:1 Version:2026-11-04T02:02:42Z/197 2026-11-04T02:02:42.938582Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:157 removed:0 size:179.8kB cached:153/153 2026-11-04T02:02:42.939918Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:154 removed:0 size:40.9kB empty:1 cached:153/154 2026-11-04T02:02:42.940528Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:183.6kB 2026-11-04T02:02:43.076190Z info ads Push debounce stable[261] 1 for config EnvoyFilter/openshift-ingress/kuadrant-e2e-worker-w0-2f5e19: 100.974807ms since last change, 100.974728ms since last push, full=true 2026-11-04T02:02:43.092263Z info ads XDS: Pushing Services:121 ConnectedEndpoints:1 Version:2026-11-04T02:02:43Z/198 2026-11-04T02:02:44.030938Z info ads Push debounce stable[262] 2 for config ConfigMap/ai-tenant-e2e-worker-w2-65afc0/kube-root-ca.crt and 1 more configs: 100.770348ms since last change, 119.69921ms since last push, full=true 2026-11-04T02:02:44.031873Z info ads XDS: Pushing Services:121 ConnectedEndpoints:1 Version:2026-11-04T02:02:44Z/199 2026-11-04T02:02:44.763820Z info ads Push debounce stable[263] 3 for config Secret/ai-tenant-e2e-worker-w2-65afc0/default-dockercfg-7k4wk and 2 more configs: 100.039737ms since last change, 124.233982ms since last push, full=false 2026-11-04T02:02:44.763878Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:44Z/199 2026-11-04T02:02:45.028373Z info model Incremental push, service payload-processing-e2e-worker-w2-65afc0.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:45.070838Z info model Incremental push, service payload-pre-processing-e2e-worker-w2-65afc0.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:45.171582Z info ads Push debounce stable[264] 6 for config ServiceEntry/openshift-ingress/payload-processing-e2e-worker-w2-65afc0.openshift-ingress.svc.cluster.local and 1 more configs: 100.681046ms since last change, 222.298634ms since last push, full=true 2026-11-04T02:02:45.172274Z info ads XDS: Pushing Services:119 ConnectedEndpoints:1 Version:2026-11-04T02:02:45Z/200 2026-11-04T02:02:45.338289Z info ads Push debounce stable[265] 1 for config Secret/openshift-ingress/payload-processing-e2e-worker-w2-65afc0-dockercfg-dkbtg: 100.737782ms since last change, 100.737699ms since last push, full=false 2026-11-04T02:02:45.338361Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:45Z/200 2026-11-04T02:02:45.612816Z info ads Push debounce stable[266] 3 for config EnvoyFilter/openshift-ingress/payload-processing-e2e-worker-w2-65afc0 and 2 more configs: 100.952762ms since last change, 202.857321ms since last push, full=true 2026-11-04T02:02:45.613068Z info ads XDS: Pushing Services:119 ConnectedEndpoints:1 Version:2026-11-04T02:02:45Z/201 2026-11-04T02:02:46.011799Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:46.018007Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:155 removed:2 size:177.3kB cached:0/151 2026-11-04T02:02:46.018749Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:154 removed:0 size:40.5kB empty:3 cached:150/154 2026-11-04T02:02:46.019536Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:183.1kB 2026-11-04T02:02:46.138908Z info ads Push debounce stable[267] 1 for config ServiceEntry/odh-ai-gateway-infra/maas-api-metrics.odh-ai-gateway-infra.svc.cluster.local: 100.934011ms since last change, 100.933938ms since last push, full=true 2026-11-04T02:02:46.139843Z info ads XDS: Pushing Services:119 ConnectedEndpoints:1 Version:2026-11-04T02:02:46Z/202 2026-11-04T02:02:47.371315Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:47.371459Z info delta SDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-11-04T02:02:47.372360Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:5 removed:0 size:2.0kB cached:0/1 2026-11-04T02:02:47.372516Z info delta EDS: PUSH INC for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:344B empty:0 cached:0/1 2026-11-04T02:02:47.373461Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:183.1kB 2026-11-04T02:02:47.381416Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:47.446232Z info ads Push debounce stable[268] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-worker-w0-2f5e19: 100.079858ms since last change, 100.079771ms since last push, full=true 2026-11-04T02:02:47.446429Z info ads XDS: Pushing Services:119 ConnectedEndpoints:1 Version:2026-11-04T02:02:47Z/203 2026-11-04T02:02:47.453187Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:154 removed:1 size:177.1kB cached:0/151 2026-11-04T02:02:47.454601Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:153 removed:0 size:40.4kB empty:2 cached:151/153 2026-11-04T02:02:47.456612Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:183.1kB 2026-11-04T02:02:47.460504Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:47.577298Z info ads Push debounce stable[269] 1 for config Gateway/openshift-ingress/e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https: 100.474363ms since last change, 100.474279ms since last push, full=true 2026-11-04T02:02:47.577447Z info ads XDS: Pushing Services:119 ConnectedEndpoints:1 Version:2026-11-04T02:02:47Z/204 2026-11-04T02:02:47.578347Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:183.1kB 2026-11-04T02:02:47.579510Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:47.602834Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:154 removed:0 size:177.1kB cached:150/151 2026-11-04T02:02:47.603949Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:153 removed:0 size:40.4kB empty:2 cached:150/153 2026-11-04T02:02:47.604656Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:183.1kB 2026-11-04T02:02:47.605644Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:47.605705Z info delta SDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-11-04T02:02:47.798773Z info ads Push Status: { "pilot_duplicate_envoy_clusters": { "kuadrant-auth-service": { "proxy": "e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress", "message": "Duplicate cluster kuadrant-auth-service found while pushing CDS" } } } 2026-11-04T02:02:47.861790Z info ads Push debounce stable[270] 3 for config ServiceEntry/openshift-ingress/e2e-worker-w0-2f5e19-openshift-default.openshift-ingress.svc.cluster.local and 1 more configs: 100.947792ms since last change, 250.602549ms since last push, full=true 2026-11-04T02:02:47.868306Z info ads XDS: Pushing Services:119 ConnectedEndpoints:1 Version:2026-11-04T02:02:47Z/205 2026-11-04T02:02:47.876255Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:154 removed:0 size:177.1kB cached:0/151 2026-11-04T02:02:47.877235Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:153 removed:0 size:41.1kB empty:2 cached:149/153 2026-11-04T02:02:48.514370Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:48.7kB 2026-11-04T02:02:48.515535Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:51.010370Z info model Incremental push, service distinct-2-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:51.018905Z info model Incremental push, service distinct-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:51.031909Z info model Incremental push, service premium-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:51.046723Z info model Incremental push, service simulator-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:51.147305Z info ads Push debounce stable[271] 8 for config ServiceEntry/e2e-models-e2e-worker-w0-2f5e19/distinct-2-w0-2f5e19-kserve-workload-svc.e2e-models-e2e-worker-w0-2f5e19.svc.cluster.local and 3 more configs: 100.381983ms since last change, 144.445747ms since last push, full=true 2026-11-04T02:02:51.148749Z info ads XDS: Pushing Services:115 ConnectedEndpoints:1 Version:2026-11-04T02:02:51Z/206 2026-11-04T02:02:51.151712Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:3 removed:4 size:502B 2026-11-04T02:02:51.151807Z info delta EDS: PUSH INC for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:0 removed:4 size:0B empty:0 cached:0/0 2026-11-04T02:02:51.152464Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:48.7kB 2026-11-04T02:02:51.154518Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:60.1kB cached:0/0 2026-11-04T02:02:51.423485Z info ads Push debounce stable[272] 1 for config VirtualService/e2e-models-e2e-worker-w0-2f5e19/openshift-ingress~e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https~*: 100.262546ms since last change, 100.262451ms since last push, full=true 2026-11-04T02:02:51.423712Z info ads XDS: Pushing Services:115 ConnectedEndpoints:1 Version:2026-11-04T02:02:51Z/207 2026-11-04T02:02:51.424568Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:48.7kB 2026-11-04T02:02:51.426122Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:45.0kB cached:0/0 2026-11-04T02:02:51.607162Z info ads Push debounce stable[273] 3 for config VirtualService/e2e-models-e2e-worker-w0-2f5e19/openshift-ingress~e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https~*: 100.898858ms since last change, 167.530134ms since last push, full=true 2026-11-04T02:02:51.607336Z info ads XDS: Pushing Services:115 ConnectedEndpoints:1 Version:2026-11-04T02:02:51Z/208 2026-11-04T02:02:51.608187Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:48.7kB 2026-11-04T02:02:51.608251Z warn constructed http route config for route https.443.default.e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:51.608291Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-11-04T02:02:52.526600Z info ads Push debounce stable[274] 1 for config ConfigMap/e2e-models-e2e-worker-w0-2f5e19/kube-root-ca.crt: 100.412205ms since last change, 100.41214ms since last push, full=false 2026-11-04T02:02:52.526659Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:51Z/208 2026-11-04T02:02:52.704829Z info ads Push debounce stable[275] 3 for config Secret/e2e-models-e2e-worker-w0-2f5e19/distinct-2-w0-2f5e19-kserve-self-signed-certs and 2 more configs: 100.197257ms since last change, 116.500449ms since last push, full=true 2026-11-04T02:02:52.705085Z info ads XDS: Pushing Services:115 ConnectedEndpoints:1 Version:2026-11-04T02:02:52Z/209 2026-11-04T02:02:52.705760Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:3 removed:0 size:502B 2026-11-04T02:02:52.706523Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:147 removed:0 size:40.5kB empty:0 cached:147/147 2026-11-04T02:02:52.707214Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:48.7kB 2026-11-04T02:02:52.707317Z warn constructed http route config for route https.443.default.e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:52.707365Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-11-04T02:02:52.707411Z info delta SDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-11-04T02:02:52.942145Z info ads Push debounce stable[276] 4 for config DestinationRule/e2e-models-e2e-worker-w0-2f5e19/simulator-w0-2f5e19-kserve-workload-svc and 3 more configs: 100.758198ms since last change, 186.282297ms since last push, full=true 2026-11-04T02:02:52.942392Z info ads XDS: Pushing Services:115 ConnectedEndpoints:1 Version:2026-11-04T02:02:52Z/210 2026-11-04T02:02:52.943264Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:3 removed:0 size:502B 2026-11-04T02:02:52.944161Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:147 removed:0 size:40.5kB empty:0 cached:147/147 2026-11-04T02:02:52.945338Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:48.7kB 2026-11-04T02:02:52.945428Z warn constructed http route config for route https.443.default.e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:52.945712Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-11-04T02:02:52.945820Z info delta SDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:4.5kB cached:1/1 2026-11-04T02:02:53.071167Z info ads Push debounce stable[277] 5 for config Secret/e2e-models-e2e-worker-w0-2f5e19/builder-dockercfg-6hzrk and 4 more configs: 100.41897ms since last change, 112.82268ms since last push, full=false 2026-11-04T02:02:53.071242Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:52Z/210 2026-11-04T02:02:53.115492Z info model Incremental push, service premium-w2-65afc0-kserve-workload-svc.e2e-models-e2e-worker-w2-65afc0.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:53.156693Z info model Incremental push, service simulator-w2-65afc0-kserve-workload-svc.e2e-models-e2e-worker-w2-65afc0.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:53.257090Z info ads Push debounce stable[278] 2 for config ServiceEntry/e2e-models-e2e-worker-w2-65afc0/premium-w2-65afc0-kserve-workload-svc.e2e-models-e2e-worker-w2-65afc0.svc.cluster.local and 1 more configs: 100.256065ms since last change, 141.545136ms since last push, full=false 2026-11-04T02:02:53.257166Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:52Z/210 2026-11-04T02:02:53.725759Z info ads Push debounce stable[279] 1 for config Secret/openshift-monitoring/prometheus-k8s: 100.207044ms since last change, 100.206972ms since last push, full=false 2026-11-04T02:02:53.725818Z info ads XDS: Incremental Pushing ConnectedEndpoints:1 Version:2026-11-04T02:02:52Z/210 2026-11-04T02:02:54.147862Z info ads Push debounce stable[280] 1 for config EnvoyFilter/openshift-ingress/kuadrant-auth-e2e-worker-w0-2f5e19: 100.283922ms since last change, 100.28383ms since last push, full=true 2026-11-04T02:02:54.148135Z info ads XDS: Pushing Services:115 ConnectedEndpoints:1 Version:2026-11-04T02:02:54Z/211 2026-11-04T02:02:54.154852Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:150 removed:0 size:172.2kB cached:0/147 2026-11-04T02:02:54.155826Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:147 removed:0 size:40.5kB empty:0 cached:147/147 2026-11-04T02:02:54.156343Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:48.7kB 2026-11-04T02:02:54.156434Z warn constructed http route config for route https.443.default.e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:54.156538Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-11-04T02:02:54.459729Z info ads Push debounce stable[281] 1 for config EnvoyFilter/openshift-ingress/kuadrant-e2e-worker-w0-2f5e19: 100.268734ms since last change, 100.268668ms since last push, full=true 2026-11-04T02:02:54.459934Z info ads XDS: Pushing Services:115 ConnectedEndpoints:1 Version:2026-11-04T02:02:54Z/212 2026-11-04T02:02:54.464237Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:149 removed:1 size:172.1kB cached:0/147 2026-11-04T02:02:54.465115Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:147 removed:0 size:40.5kB empty:0 cached:147/147 2026-11-04T02:02:54.465656Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:3.9kB 2026-11-04T02:02:54.465751Z warn constructed http route config for route https.443.default.e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:54.465814Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-11-04T02:02:54.903260Z info ads Push debounce stable[282] 1 for config Gateway/openshift-ingress/e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https: 100.232665ms since last change, 100.232573ms since last push, full=true 2026-11-04T02:02:54.903402Z info ads XDS: Pushing Services:115 ConnectedEndpoints:1 Version:2026-11-04T02:02:54Z/213 2026-11-04T02:02:54.903766Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:3.9kB 2026-11-04T02:02:54.903796Z warn constructed http route config for route https.443.default.e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https.openshift-ingress on port 443 with no vhosts; Setting up a default 404 vhost 2026-11-04T02:02:54.903821Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:126B cached:0/0 2026-11-04T02:02:55.287572Z info model Incremental push, service e2e-worker-w0-2f5e19-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:55.396045Z info ads Push debounce stable[283] 6 for config Gateway/openshift-ingress/e2e-worker-w0-2f5e19~istio-autogenerated-k8s-gateway~https and 4 more configs: 100.052321ms since last change, 127.374742ms since last push, full=true 2026-11-04T02:02:55.396778Z info ads XDS: Pushing Services:114 ConnectedEndpoints:1 Version:2026-11-04T02:02:55Z/214 2026-11-04T02:02:55.397978Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:146 removed:3 size:169.1kB cached:142/145 2026-11-04T02:02:55.398471Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:147 removed:0 size:39.1kB empty:2 cached:145/147 2026-11-04T02:02:55.398518Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:0 removed:1 size:0B 2026-11-04T02:02:55.398533Z warn buildGatewayRoutes: no gateways for router e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress 2026-11-04T02:02:55.398556Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:98B cached:0/0 2026-11-04T02:02:55.398582Z warn ads proxy e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress attempted to access unauthorized certificates e2e-worker-w0-2f5e19-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-11-04T02:02:56.740116Z info model Incremental push, service maas-api-e2e-worker-w2-65afc0.odh-ai-gateway-infra.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:02:56.946195Z info ads Push debounce stable[284] 7 for config Secret/odh-ai-gateway-infra/maas-api-e2e-worker-w2-65afc0-serving-cert and 6 more configs: 100.894459ms since last change, 220.227697ms since last push, full=true 2026-11-04T02:02:56.946989Z info ads XDS: Pushing Services:113 ConnectedEndpoints:1 Version:2026-11-04T02:02:56Z/215 2026-11-04T02:02:56.947604Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:2 removed:1 size:1.4kB cached:0/1 2026-11-04T02:02:56.948436Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:147 removed:0 size:38.8kB empty:3 cached:143/147 2026-11-04T02:02:56.948505Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:0 removed:0 size:0B 2026-11-04T02:02:56.948573Z warn buildGatewayRoutes: no gateways for router e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress 2026-11-04T02:02:56.948627Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:98B cached:0/0 2026-11-04T02:02:56.948667Z warn ads proxy e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress attempted to access unauthorized certificates e2e-worker-w0-2f5e19-gw-service-tls: cross namespace secret reference requires ReferenceGrant 2026-11-04T02:02:57.157897Z info ads Push debounce stable[285] 2 for config EnvoyFilter/openshift-ingress/maas-model-access-logs-e2e-worker-w2-65afc0 and 1 more configs: 100.082557ms since last change, 188.560355ms since last push, full=true 2026-11-04T02:02:57.158622Z info ads XDS: Pushing Services:113 ConnectedEndpoints:1 Version:2026-11-04T02:02:57Z/216 2026-11-04T02:02:57.159938Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:145 removed:0 size:168.0kB cached:143/144 2026-11-04T02:02:57.160732Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:147 removed:0 size:38.8kB empty:3 cached:143/147 2026-11-04T02:02:57.160783Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:0 removed:0 size:0B 2026-11-04T02:02:57.160799Z warn buildGatewayRoutes: no gateways for router e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress 2026-11-04T02:02:57.160827Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:98B cached:0/0 2026-11-04T02:02:58.378550Z info ads Push debounce stable[286] 1 for config EnvoyFilter/openshift-ingress/kuadrant-ratelimiting-e2e-worker-w2-65afc0: 100.555753ms since last change, 100.555667ms since last push, full=true 2026-11-04T02:02:58.378773Z info ads XDS: Pushing Services:113 ConnectedEndpoints:1 Version:2026-11-04T02:02:58Z/217 2026-11-04T02:02:58.379813Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:145 removed:0 size:168.0kB cached:144/144 2026-11-04T02:02:58.380639Z info delta EDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:147 removed:0 size:38.8kB empty:3 cached:144/147 2026-11-04T02:02:58.380728Z info delta LDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:0 removed:0 size:0B 2026-11-04T02:02:58.380749Z warn buildGatewayRoutes: no gateways for router e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress 2026-11-04T02:02:58.380777Z info delta RDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:1 removed:0 size:98B cached:0/0 2026-11-04T02:02:58.583280Z info ads Push debounce stable[287] 1 for config EnvoyFilter/openshift-ingress/kuadrant-e2e-worker-w2-65afc0: 100.237943ms since last change, 100.237864ms since last push, full=true 2026-11-04T02:02:58.585868Z info ads XDS: Pushing Services:113 ConnectedEndpoints:1 Version:2026-11-04T02:02:58Z/218 2026-11-04T02:02:58.587002Z info delta CDS: PUSH for node:e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress resources:145 removed:0 size:168.0kB cached:144/144 2026-11-04T02:03:00.771391Z info ads Push debounce stable[288] 1 for config Gateway/openshift-ingress/e2e-worker-w2-65afc0~istio-autogenerated-k8s-gateway~https: 100.586599ms since last change, 100.586501ms since last push, full=true 2026-11-04T02:03:00.771575Z info ads XDS: Pushing Services:113 ConnectedEndpoints:1 Version:2026-11-04T02:03:00Z/219 2026-11-04T02:03:05.653005Z info delta ADS: "10.132.0.96:56380" e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress-6 terminated 2026-11-04T02:03:05.653063Z info ads Client closed connection e2e-worker-w0-2f5e19-openshift-default-748f9fcf45-flhmp.openshift-ingress-6 2026-11-04T02:03:13.281695Z info ads Push debounce stable[289] 1 for config ServiceEntry/openshift-ingress/e2e-worker-w2-65afc0-openshift-default.openshift-ingress.svc.cluster.local: 100.2224ms since last change, 100.222261ms since last push, full=false 2026-11-04T02:03:13.281766Z info ads XDS: Incremental Pushing ConnectedEndpoints:0 Version:2026-11-04T02:03:00Z/219 2026-11-04T02:03:13.930710Z info model Incremental push, service premium-w2-65afc0-kserve-workload-svc.e2e-models-e2e-worker-w2-65afc0.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:03:13.942958Z info model Incremental push, service simulator-w2-65afc0-kserve-workload-svc.e2e-models-e2e-worker-w2-65afc0.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:03:14.043943Z info ads Push debounce stable[290] 4 for config ServiceEntry/e2e-models-e2e-worker-w2-65afc0/premium-w2-65afc0-kserve-workload-svc.e2e-models-e2e-worker-w2-65afc0.svc.cluster.local and 1 more configs: 100.924984ms since last change, 122.719563ms since last push, full=true 2026-11-04T02:03:14.044545Z info ads XDS: Pushing Services:111 ConnectedEndpoints:0 Version:2026-11-04T02:03:14Z/220 2026-11-04T02:03:14.711275Z info ads Push debounce stable[291] 2 for config VirtualService/e2e-models-e2e-worker-w2-65afc0/openshift-ingress~e2e-worker-w2-65afc0~istio-autogenerated-k8s-gateway~https~*: 100.466894ms since last change, 114.360867ms since last push, full=true 2026-11-04T02:03:14.711578Z info ads XDS: Pushing Services:111 ConnectedEndpoints:0 Version:2026-11-04T02:03:14Z/221 2026-11-04T02:03:15.220747Z info ads Push debounce stable[292] 8 for config Secret/e2e-models-e2e-worker-w2-65afc0/builder-dockercfg-tgbfg and 7 more configs: 101.131483ms since last change, 145.138628ms since last push, full=true 2026-11-04T02:03:15.220996Z info ads XDS: Pushing Services:111 ConnectedEndpoints:0 Version:2026-11-04T02:03:15Z/222 2026-11-04T02:03:15.953964Z info ads Push debounce stable[293] 1 for config ConfigMap/e2e-models-e2e-worker-w2-65afc0/kube-root-ca.crt: 100.319626ms since last change, 100.319553ms since last push, full=false 2026-11-04T02:03:15.954041Z info ads XDS: Incremental Pushing ConnectedEndpoints:0 Version:2026-11-04T02:03:15Z/222 2026-11-04T02:03:16.287126Z info ads Push debounce stable[294] 2 for config EnvoyFilter/openshift-ingress/kuadrant-auth-e2e-worker-w2-65afc0 and 1 more configs: 100.269976ms since last change, 102.935744ms since last push, full=true 2026-11-04T02:03:16.287275Z info ads XDS: Pushing Services:111 ConnectedEndpoints:0 Version:2026-11-04T02:03:16Z/223 2026-11-04T02:03:16.407742Z info ads Push debounce stable[295] 1 for config EnvoyFilter/openshift-ingress/kuadrant-e2e-worker-w2-65afc0: 100.239448ms since last change, 100.239361ms since last push, full=true 2026-11-04T02:03:16.407985Z info ads XDS: Pushing Services:111 ConnectedEndpoints:0 Version:2026-11-04T02:03:16Z/224 2026-11-04T02:03:16.978914Z info ads Push debounce stable[296] 1 for config Gateway/openshift-ingress/e2e-worker-w2-65afc0~istio-autogenerated-k8s-gateway~https: 100.180914ms since last change, 100.18084ms since last push, full=true 2026-11-04T02:03:16.979051Z info ads XDS: Pushing Services:111 ConnectedEndpoints:0 Version:2026-11-04T02:03:16Z/225 2026-11-04T02:03:17.361299Z info model Incremental push, service e2e-worker-w2-65afc0-openshift-default.openshift-ingress.svc.cluster.local at shard Kubernetes/Kubernetes has no endpoints 2026-11-04T02:03:17.461743Z info ads Push debounce stable[297] 6 for config Gateway/openshift-ingress/e2e-worker-w2-65afc0~istio-autogenerated-k8s-gateway~https and 4 more configs: 100.38545ms since last change, 146.807623ms since last push, full=true 2026-11-04T02:03:17.462396Z info ads XDS: Pushing Services:110 ConnectedEndpoints:0 Version:2026-11-04T02:03:17Z/226