./mage -v ci:teste2e go: downloading golang.org/x/sync v0.20.0 go: downloading golang.org/x/tools v0.44.0 go: downloading golang.org/x/crypto v0.51.0 go: downloading golang.org/x/sys v0.45.0 go: downloading golang.org/x/term v0.43.0 go: downloading golang.org/x/net v0.55.0 go: downloading google.golang.org/genproto/googleapis/api v0.0.0-20260819154853-08b0e4226688 go: downloading google.golang.org/protobuf v1.36.12 go: downloading golang.org/x/text v0.37.0 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20260818201246-1b0934165a6f go: downloading golang.org/x/mod v0.35.0 Running target: CI:TestE2E I0823 02:51:44.893285 16908 magefile.go:525] setting up new custom bundle for testing... I0823 02:51:45.253029 16908 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1787453505-nyvl -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: docker-build to image I0823 02:51:46.408699 16908 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1787453505-nyvl: quay.io/redhat-appstudio-qe/test-images@sha256:169d63e22ecc77662df923935a9e25c5eb1fdb4929b2c879d0d7ca842bf1e6e7 I0823 02:51:46.408729 16908 magefile.go:531] To use the custom docker bundle locally, run below cmd: export CUSTOM_DOCKER_BUILD_PIPELINE_BUNDLE=quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1787453505-nyvl I0823 02:51:46.408754 16908 integration_service.go:49] checking if repository is integration-service I0823 02:51:46.408763 16908 image_controller.go:49] checking if repository is image-controller I0823 02:51:46.408771 16908 build_service.go:50] checking if repository is build-service I0823 02:51:46.408778 16908 e2e_repo.go:347] checking if repository is e2e-tests I0823 02:51:46.408784 16908 e2e_repo.go:335] multi-platform tests and require sprayproxy registering are set to TRUE exec: git "diff" "--name-status" "upstream/main..HEAD" I0823 02:51:46.413444 16908 util.go:451] The following files, go.mod, go.sum, were changed! exec: go "install" "-mod=mod" "github.com/onsi/ginkgo/v2/ginkgo" go: downloading github.com/go-task/slim-sprig/v3 v3.0.0 go: downloading github.com/google/pprof v0.0.0-20260115054156-294ebfa9ad83 I0823 02:51:49.712505 16908 install.go:226] cloning 'https://github.com/redhat-appstudio/infra-deployments' (ref: 'refs/heads/main', remote: 'upstream') Enumerating objects: 92483, done. Counting objects: 0% (1/5228) Counting objects: 1% (53/5228) Counting objects: 2% (105/5228) Counting objects: 3% (157/5228) Counting objects: 4% (210/5228) Counting objects: 5% (262/5228) Counting objects: 6% (314/5228) Counting objects: 7% (366/5228) Counting objects: 8% (419/5228) Counting objects: 9% (471/5228) Counting objects: 10% (523/5228) Counting objects: 11% (576/5228) Counting objects: 12% (628/5228) Counting objects: 13% (680/5228) Counting objects: 14% (732/5228) Counting objects: 15% (785/5228) Counting objects: 16% (837/5228) Counting objects: 17% (889/5228) Counting objects: 18% (942/5228) Counting objects: 19% (994/5228) Counting objects: 20% (1046/5228) Counting objects: 21% (1098/5228) Counting objects: 22% (1151/5228) Counting objects: 23% (1203/5228) Counting objects: 24% (1255/5228) Counting objects: 25% (1307/5228) Counting objects: 26% (1360/5228) Counting objects: 27% (1412/5228) Counting objects: 28% (1464/5228) Counting objects: 29% (1517/5228) Counting objects: 30% (1569/5228) Counting objects: 31% (1621/5228) Counting objects: 32% (1673/5228) Counting objects: 33% (1726/5228) Counting objects: 34% (1778/5228) Counting objects: 35% (1830/5228) Counting objects: 36% (1883/5228) Counting objects: 37% (1935/5228) Counting objects: 38% (1987/5228) Counting objects: 39% (2039/5228) Counting objects: 40% (2092/5228) Counting objects: 41% (2144/5228) Counting objects: 42% (2196/5228) Counting objects: 43% (2249/5228) Counting objects: 44% (2301/5228) Counting objects: 45% (2353/5228) Counting objects: 46% (2405/5228) Counting objects: 47% (2458/5228) Counting objects: 48% (2510/5228) Counting objects: 49% (2562/5228) Counting objects: 50% (2614/5228) Counting objects: 51% (2667/5228) Counting objects: 52% (2719/5228) Counting objects: 53% (2771/5228) Counting objects: 54% (2824/5228) Counting objects: 55% (2876/5228) Counting objects: 56% (2928/5228) Counting objects: 57% (2980/5228) Counting objects: 58% (3033/5228) Counting objects: 59% (3085/5228) Counting objects: 60% (3137/5228) Counting objects: 61% (3190/5228) Counting objects: 62% (3242/5228) Counting objects: 63% (3294/5228) Counting objects: 64% (3346/5228) Counting objects: 65% (3399/5228) Counting objects: 66% (3451/5228) Counting objects: 67% (3503/5228) Counting objects: 68% (3556/5228) Counting objects: 69% (3608/5228) Counting objects: 70% (3660/5228) Counting objects: 71% (3712/5228) Counting objects: 72% (3765/5228) Counting objects: 73% (3817/5228) Counting objects: 74% (3869/5228) Counting objects: 75% (3921/5228) Counting objects: 76% (3974/5228) Counting objects: 77% (4026/5228) Counting objects: 78% (4078/5228) Counting objects: 79% (4131/5228) Counting objects: 80% (4183/5228) Counting objects: 81% (4235/5228) Counting objects: 82% (4287/5228) Counting objects: 83% (4340/5228) Counting objects: 84% (4392/5228) Counting objects: 85% (4444/5228) Counting objects: 86% (4497/5228) Counting objects: 87% (4549/5228) Counting objects: 88% (4601/5228) Counting objects: 89% (4653/5228) Counting objects: 90% (4706/5228) Counting objects: 91% (4758/5228) Counting objects: 92% (4810/5228) Counting objects: 93% (4863/5228) Counting objects: 94% (4915/5228) Counting objects: 95% (4967/5228) Counting objects: 96% (5019/5228) Counting objects: 97% (5072/5228) Counting objects: 98% (5124/5228) Counting objects: 99% (5176/5228) Counting objects: 100% (5228/5228) Counting objects: 100% (5228/5228), done. Compressing objects: 0% (1/270) Compressing objects: 1% (3/270) Compressing objects: 2% (6/270) Compressing objects: 3% (9/270) Compressing objects: 4% (11/270) Compressing objects: 5% (14/270) Compressing objects: 6% (17/270) Compressing objects: 7% (19/270) Compressing objects: 8% (22/270) Compressing objects: 9% (25/270) Compressing objects: 10% (27/270) Compressing objects: 11% (30/270) Compressing objects: 12% (33/270) Compressing objects: 13% (36/270) Compressing objects: 14% (38/270) Compressing objects: 15% (41/270) Compressing objects: 16% (44/270) Compressing objects: 17% (46/270) Compressing objects: 18% (49/270) Compressing objects: 19% (52/270) Compressing objects: 20% (54/270) Compressing objects: 21% (57/270) Compressing objects: 22% (60/270) Compressing objects: 23% (63/270) Compressing objects: 24% (65/270) Compressing objects: 25% (68/270) Compressing objects: 26% (71/270) Compressing objects: 27% (73/270) Compressing objects: 28% (76/270) Compressing objects: 29% (79/270) Compressing objects: 30% (81/270) Compressing objects: 31% (84/270) Compressing objects: 32% (87/270) Compressing objects: 33% (90/270) Compressing objects: 34% (92/270) Compressing objects: 35% (95/270) Compressing objects: 36% (98/270) Compressing objects: 37% (100/270) Compressing objects: 38% (103/270) Compressing objects: 39% (106/270) Compressing objects: 40% (108/270) Compressing objects: 41% (111/270) Compressing objects: 42% (114/270) Compressing objects: 43% (117/270) Compressing objects: 44% (119/270) Compressing objects: 45% (122/270) Compressing objects: 46% (125/270) Compressing objects: 47% (127/270) Compressing objects: 48% (130/270) Compressing objects: 49% (133/270) Compressing objects: 50% (135/270) Compressing objects: 51% (138/270) Compressing objects: 52% (141/270) Compressing objects: 53% (144/270) Compressing objects: 54% (146/270) Compressing objects: 55% (149/270) Compressing objects: 56% (152/270) Compressing objects: 57% (154/270) Compressing objects: 58% (157/270) Compressing objects: 59% (160/270) Compressing objects: 60% (162/270) Compressing objects: 61% (165/270) Compressing objects: 62% (168/270) Compressing objects: 63% (171/270) Compressing objects: 64% (173/270) Compressing objects: 65% (176/270) Compressing objects: 66% (179/270) Compressing objects: 67% (181/270) Compressing objects: 68% (184/270) Compressing objects: 69% (187/270) Compressing objects: 70% (189/270) Compressing objects: 71% (192/270) Compressing objects: 72% (195/270) Compressing objects: 73% (198/270) Compressing objects: 74% (200/270) Compressing objects: 75% (203/270) Compressing objects: 76% (206/270) Compressing objects: 77% (208/270) Compressing objects: 78% (211/270) Compressing objects: 79% (214/270) Compressing objects: 80% (216/270) Compressing objects: 81% (219/270) Compressing objects: 82% (222/270) Compressing objects: 83% (225/270) Compressing objects: 84% (227/270) Compressing objects: 85% (230/270) Compressing objects: 86% (233/270) Compressing objects: 87% (235/270) Compressing objects: 88% (238/270) Compressing objects: 89% (241/270) Compressing objects: 90% (243/270) Compressing objects: 91% (246/270) Compressing objects: 92% (249/270) Compressing objects: 93% (252/270) Compressing objects: 94% (254/270) Compressing objects: 95% (257/270) Compressing objects: 96% (260/270) Compressing objects: 97% (262/270) Compressing objects: 98% (265/270) Compressing objects: 99% (268/270) Compressing objects: 100% (270/270) Compressing objects: 100% (270/270), done. Total 92483 (delta 5039), reused 4960 (delta 4958), pack-reused 87255 (from 2) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. ============================================================================= [2026-08-23 02:51:55] [STEP] Starting Konflux Cluster Bootstrap ============================================================================= [2026-08-23 02:51:55] [INFO] Mode: preview [2026-08-23 02:51:55] [INFO] Options: OBO=disabled, EAAS=disabled, OPERATOR_OVERLAY=disabled [2026-08-23 02:51:55] [INFO] Start time: 2026-08-23 02:51:55 UTC ============================================================================= [2026-08-23 02:51:55] [STEP] Phase 1: Deploying ArgoCD ============================================================================= ============================================================================= [2026-08-23 02:51:55] [STEP] Deploying OpenShift GitOps (ArgoCD) ============================================================================= [2026-08-23 02:51:55] [SUBSTEP] Verifying cluster-admin permissions [2026-08-23 02:51:55] [SUCCESS] User 'cluster-admin' has cluster-admin permissions [2026-08-23 02:51:55] [SUBSTEP] Installing OpenShift GitOps operator subscription clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created subscription.operators.coreos.com/openshift-gitops-operator created [2026-08-23 02:51:56] [SUCCESS] GitOps operator subscription applied [2026-08-23 02:51:56] [SUBSTEP] Waiting for default ArgoCD project to be created [2026-08-23 02:51:56] [WAITING] Default project not yet available (5s/300s) [2026-08-23 02:52:01] [WAITING] Default project not yet available (10s/300s) [2026-08-23 02:52:06] [WAITING] Default project not yet available (15s/300s) [2026-08-23 02:52:12] [WAITING] Default project not yet available (20s/300s) [2026-08-23 02:52:17] [WAITING] Default project not yet available (25s/300s) [2026-08-23 02:52:22] [WAITING] Default project not yet available (30s/300s) [2026-08-23 02:52:27] [SUCCESS] Default ArgoCD project is available [2026-08-23 02:52:27] [SUBSTEP] Waiting for OpenShift GitOps route to be created [2026-08-23 02:52:28] [SUCCESS] OpenShift GitOps route is available [2026-08-23 02:52:28] [SUBSTEP] Configuring ArgoCD repo server resources and timeout argocd.argoproj.io/openshift-gitops patched [2026-08-23 02:52:28] [SUCCESS] Repo server configured: timeout=5m, cpu=100m, memory=100Mi [2026-08-23 02:52:28] [SUBSTEP] Configuring ArgoCD application controller resources argocd.argoproj.io/openshift-gitops patched [2026-08-23 02:52:28] [SUCCESS] Application controller configured: cpu=4, memory=4Gi [2026-08-23 02:52:28] [SUBSTEP] Switching ArgoCD route to re-encryption TLS argocd.argoproj.io/openshift-gitops patched [2026-08-23 02:52:29] [SUCCESS] Route TLS termination set to 'reencrypt' [2026-08-23 02:52:29] [SUBSTEP] Restarting ArgoCD server after TLS configuration change pod "openshift-gitops-server-6944966b75-7qv5k" deleted [2026-08-23 02:52:30] [SUCCESS] ArgoCD server pods deleted for restart [2026-08-23 02:52:30] [SUBSTEP] Granting admin role to authenticated users [2026-08-23 02:52:30] [INFO] Note: This should be updated once proper access policy is in place argocd.argoproj.io/openshift-gitops patched [2026-08-23 02:52:30] [SUCCESS] RBAC policy set: system:authenticated -> role:admin [2026-08-23 02:52:30] [SUBSTEP] Configuring PVC health check (WaitForFirstConsumer workaround) Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) [2026-08-23 02:52:30] [SUCCESS] PVC health customization applied (Pending/Bound = Healthy) [2026-08-23 02:52:30] [SUBSTEP] Enabling Helm support in Kustomize builds argocd.argoproj.io/openshift-gitops patched [2026-08-23 02:52:30] [SUCCESS] Kustomize build options set: --enable-helm [2026-08-23 02:52:30] [SUBSTEP] Configuring ArgoCD to ignore aggregated roles in diff argocd.argoproj.io/openshift-gitops patched [2026-08-23 02:52:31] [SUCCESS] ignoreAggregatedRoles set to true [2026-08-23 02:52:31] [SUBSTEP] Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched [2026-08-23 02:52:31] [SUCCESS] Resource tracking method set to 'annotation' [2026-08-23 02:52:31] [SUBSTEP] Restarting GitOps server deployment deployment.apps/openshift-gitops-server restarted [2026-08-23 02:52:31] [SUCCESS] GitOps server restart initiated [2026-08-23 02:52:31] [INFO] Waiting for rollout to complete... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... deployment "openshift-gitops-server" successfully rolled out [2026-08-23 02:53:02] [SUCCESS] GitOps server rollout complete ============================================================================= [2026-08-23 02:53:02] [STEP] ArgoCD Access Information ============================================================================= [2026-08-23 02:53:02] [INFO] ArgoCD URL: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com [2026-08-23 02:53:02] [INFO] Authentication: Use 'Login with OpenShift' button (OpenShift credentials) [2026-08-23 02:53:02] [SUBSTEP] Verifying ArgoCD route is accessible [2026-08-23 02:53:22] [WAITING] Waiting for route to respond (5s/120s) [2026-08-23 02:53:27] [SUCCESS] ArgoCD is accessible at https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com [ARGOCD_DEPLOY_JSON] {"status":"success","url":"https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com","namespace":"openshift-gitops","auth_method":"openshift"} ============================================================================= [2026-08-23 02:53:27] [STEP] OpenShift GitOps Deployment Complete ============================================================================= ============================================================================= [2026-08-23 02:53:27] [STEP] Phase 2: Bootstrapping Host Cluster ============================================================================= [2026-08-23 02:53:27] [INFO] Bootstrapping host cluster components [2026-08-23 02:53:27] [INFO] No preview.env file found - using environment variables only [2026-08-23 02:53:27] [SUCCESS] Host cluster bootstrap complete ============================================================================= [2026-08-23 02:53:27] [STEP] Phase 3: Bootstrapping Member Cluster ============================================================================= [2026-08-23 02:53:27] [INFO] Bootstrapping member cluster components [2026-08-23 02:53:27] [INFO] No preview.env file found - using environment variables only [2026-08-23 02:53:27] [SUBSTEP] Configuring Pipeline Service secrets Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation namespace/product-kubearchive-logging created Creating DB secret secret/tekton-results-database created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config secret/minio-storage-configuration created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config MinIO config already exists, skipping creation Creating Postgres TLS certs secret/postgresql-tls created configmap/rds-root-crt created [2026-08-23 02:53:33] [SUCCESS] Pipeline Service secrets configured [2026-08-23 02:53:33] [SUBSTEP] Configuring GitHub secrets [2026-08-23 02:53:33] [INFO] GitHub token provided - creating secrets namespace/application-service created Creating a has secret from legacy token secret/has-github-token created [2026-08-23 02:53:37] [SUCCESS] GitHub secrets configured [2026-08-23 02:53:37] [SUBSTEP] Configuring Image Controller secrets [2026-08-23 02:53:37] [INFO] Quay organization: redhat-appstudio-qe Creating a secret with a token for Image Controller namespace/image-controller created secret/quaytoken created [2026-08-23 02:53:39] [SUCCESS] Image Controller secrets configured [2026-08-23 02:53:39] [SUCCESS] Member cluster bootstrap complete ============================================================================= [2026-08-23 02:53:39] [STEP] Phase 4: Bootstrapping Common Components ============================================================================= [2026-08-23 02:53:39] [INFO] Bootstrapping common cluster components [2026-08-23 02:53:39] [INFO] No preview.env file found at /tmp/tmp.hmcJ8gLLSW/tmp/infra-deployments/hack/../hack/preview.env - using environment variables only [2026-08-23 02:53:39] [SUBSTEP] Configuring Docker Hub pull secret Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.IHpYmk6INS secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.IHpYmk6INS secret/docker-io-pull created [2026-08-23 02:53:40] [SUCCESS] Docker Hub pull secret configured [2026-08-23 02:53:40] [SUCCESS] Common cluster bootstrap complete ============================================================================= [2026-08-23 02:53:40] [STEP] Phase 5: Mode-Specific Deployment (preview) ============================================================================= [2026-08-23 02:53:40] [INFO] Deploying preview configuration ============================================================================= [2026-08-23 02:53:40] [STEP] Starting Konflux Preview Environment Setup ============================================================================= [2026-08-23 02:53:40] [INFO] Script: /tmp/tmp.hmcJ8gLLSW/tmp/infra-deployments/hack/../hack/preview.sh [2026-08-23 02:53:40] [INFO] Options: OBO=false, GRAFANA=false, EAAS=false, OVERLAY=development [2026-08-23 02:53:40] [INFO] Start time: 2026-08-23 02:53:40 UTC ============================================================================= [2026-08-23 02:53:40] [STEP] Cluster Context Information ============================================================================= [2026-08-23 02:53:41] [INFO] OpenShift Version: 4.18.9 [2026-08-23 02:53:41] [INFO] API Server: https://api.kx-71ec122d0a.s901.p3.openshiftapps.com:443 [2026-08-23 02:53:41] [INFO] Cluster ID: a460bb25-ec92-4abe-a1de-9ac2096aadc7 [2026-08-23 02:53:41] [INFO] Cluster Domain: apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com [2026-08-23 02:53:41] [INFO] Total Nodes: 3 [2026-08-23 02:53:41] [INFO] - Master nodes: 0 [2026-08-23 02:53:41] [INFO] - Worker nodes: 3 [2026-08-23 02:53:41] [SUCCESS] Cluster operators: All healthy [CLUSTER_CONTEXT_JSON] {"ocp_version":"4.18.9","api_server":"https://api.kx-71ec122d0a.s901.p3.openshiftapps.com:443","cluster_id":"a460bb25-ec92-4abe-a1de-9ac2096aadc7","cluster_domain":"apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com","total_nodes":3,"master_nodes":0,"worker_nodes":3,"degraded_operators":0} Switched to a new branch 'preview-main-irfz' [2026-08-23 02:53:41] [SUCCESS] Git environment initialized [2026-08-23 02:53:41] [INFO] - Repository URL: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-08-23 02:53:41] [INFO] - Source branch: main [2026-08-23 02:53:41] [INFO] - Preview branch: preview-main-irfz [2026-08-23 02:53:41] [INFO] - GitHub org: redhat-appstudio-qe ============================================================================= [2026-08-23 02:53:41] [STEP] Patching ArgoCD application manifests to use fork repository ============================================================================= [2026-08-23 02:53:41] [INFO] Setting repoURL to: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-08-23 02:53:41] [INFO] Setting targetRevision to: preview-main-irfz [2026-08-23 02:53:41] [SUBSTEP] Patched: application-patch.yaml [2026-08-23 02:53:41] [SUBSTEP] Patched: application-set-patch.yaml [2026-08-23 02:53:41] [SUBSTEP] Patched: application-set-multisrc-src-1-patch.yaml [2026-08-23 02:53:41] [SUCCESS] All ArgoCD patch files updated ============================================================================= [2026-08-23 02:53:41] [STEP] Labeling cluster nodes for Konflux workloads ============================================================================= [2026-08-23 02:53:41] [INFO] Reference: https://github.com/redhat-appstudio/infra-deployments/pull/4415 [2026-08-23 02:53:42] [INFO] Found 3 nodes to label with 'konflux-ci.dev/workload=konflux-tenants' [2026-08-23 02:53:42] [SUBSTEP] Labeling node/ip-10-0-138-172.ec2.internal node/ip-10-0-138-172.ec2.internal labeled [2026-08-23 02:53:42] [SUCCESS] Successfully labeled node/ip-10-0-138-172.ec2.internal [2026-08-23 02:53:42] [SUBSTEP] Labeling node/ip-10-0-151-60.ec2.internal node/ip-10-0-151-60.ec2.internal labeled [2026-08-23 02:53:42] [SUCCESS] Successfully labeled node/ip-10-0-151-60.ec2.internal [2026-08-23 02:53:42] [SUBSTEP] Labeling node/ip-10-0-160-33.ec2.internal node/ip-10-0-160-33.ec2.internal labeled [2026-08-23 02:53:42] [SUCCESS] Successfully labeled node/ip-10-0-160-33.ec2.internal [2026-08-23 02:53:42] [SUBSTEP] Verifying labels on all nodes... [2026-08-23 02:53:42] [SUCCESS] All 3 nodes labeled and verified successfully ============================================================================= [2026-08-23 02:53:42] [STEP] Checking OCP version for Kueue compatibility ============================================================================= [2026-08-23 02:53:42] [INFO] Detected OpenShift Container Platform version: 4.18.9 (minor: 18) [2026-08-23 02:53:42] [SUCCESS] OCP version 4.18.9 meets Kueue requirements - Kueue will be deployed ============================================================================= [2026-08-23 02:53:42] [STEP] Configuring GitHub organization ============================================================================= [2026-08-23 02:53:42] [INFO] Setting GitHub org to: redhat-appstudio-qe [2026-08-23 02:53:42] [INFO] Configuring GitHub organization for Application Service (HAS) [2026-08-23 02:53:42] [INFO] - Target org: redhat-appstudio-qe [2026-08-23 02:53:42] [INFO] - Config file: /tmp/tmp.hmcJ8gLLSW/tmp/infra-deployments/hack/../components/has/base/kustomization.yaml [2026-08-23 02:53:42] [SUCCESS] GitHub organization set to 'redhat-appstudio-qe' [2026-08-23 02:53:42] [SUCCESS] Verified: Configuration updated correctly [2026-08-23 02:53:42] [SUCCESS] GitHub organization configured ============================================================================= [2026-08-23 02:53:42] [STEP] Configuring Rekor server hostname ============================================================================= [2026-08-23 02:53:42] [INFO] Cluster domain: apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com [2026-08-23 02:53:42] [INFO] Rekor server hostname: rekor.apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com [2026-08-23 02:53:42] [SUCCESS] Rekor server hostname configured ============================================================================= [2026-08-23 02:53:42] [STEP] Applying service image overrides from environment variables ============================================================================= [2026-08-23 02:53:42] [INFO] No service image overrides configured - using default images ============================================================================= [2026-08-23 02:53:42] [STEP] Committing and pushing preview changes ============================================================================= [preview-main-irfz 54ca22ea1] Preview mode, do not merge into main 8 files changed, 15 insertions(+), 19 deletions(-) remote: remote: Create a pull request for 'preview-main-irfz' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-irfz remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-irfz -> preview-main-irfz branch 'preview-main-irfz' set up to track 'qe/preview-main-irfz'. [2026-08-23 02:53:44] [SUCCESS] Preview changes committed and pushed to qe/preview-main-irfz ============================================================================= [2026-08-23 02:53:44] [STEP] Deploying ArgoCD applications ============================================================================= [2026-08-23 02:53:44] [SUBSTEP] Applying root Application from: /tmp/tmp.hmcJ8gLLSW/tmp/infra-deployments/hack/../argo-cd-apps/app-of-app-sets/development application.argoproj.io/all-application-sets created [2026-08-23 02:53:44] [SUCCESS] Root Application 'all-application-sets' created [2026-08-23 02:53:44] [SUBSTEP] Waiting for 'all-application-sets' to become Healthy and Synced [2026-08-23 02:53:45] [WAITING] Root application status: ' ' (target: 'Healthy Synced') - 5s elapsed [2026-08-23 02:53:50] [WAITING] Root application status: ' ' (target: 'Healthy Synced') - 10s elapsed [2026-08-23 02:53:55] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 15s elapsed [2026-08-23 02:54:00] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 20s elapsed [2026-08-23 02:54:05] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 25s elapsed [2026-08-23 02:54:11] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 30s elapsed [2026-08-23 02:54:16] [SUCCESS] Root application 'all-application-sets' is Healthy and Synced [2026-08-23 02:54:16] [SUBSTEP] Triggering hard refresh on all ArgoCD applications [2026-08-23 02:54:16] [INFO] Found 43 applications to refresh application.argoproj.io/has-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/monitoring-workload-custom-kube-state-metrics-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/backup-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/monitoring-registry-in-cluster-local patched application.argoproj.io/smee-client-in-cluster-local patched application.argoproj.io/disaster-recovery-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/konflux-info-in-cluster-local patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/konflux-verifications-rd-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/image-rbac-proxy-in-cluster-local patched application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/dummy-deployment-in-cluster-local patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) application.argoproj.io/all-application-sets patched application.argoproj.io/enterprise-contract-in-cluster-local patched [2026-08-23 02:54:24] [SUCCESS] Hard refresh triggered on all 43 applications [2026-08-23 02:54:24] [SUBSTEP] Waiting for refresh operations to complete [2026-08-23 02:54:24] [PROGRESS] Refresh: 0/43 complete | 43 still refreshing (5s elapsed) [2026-08-23 02:54:29] [PROGRESS] Refresh: 0/43 complete | 43 still refreshing (10s elapsed) [2026-08-23 02:54:35] [PROGRESS] Refresh: 2/43 complete | 41 still refreshing (15s elapsed) [2026-08-23 02:54:40] [PROGRESS] Refresh: 9/43 complete | 34 still refreshing (20s elapsed) [2026-08-23 02:54:45] [PROGRESS] Refresh: 9/43 complete | 34 still refreshing (25s elapsed) [2026-08-23 02:54:51] [PROGRESS] Refresh: 27/43 complete | 16 still refreshing (30s elapsed) [2026-08-23 02:54:56] [PROGRESS] Refresh: 27/43 complete | 16 still refreshing (35s elapsed) [2026-08-23 02:55:01] [PROGRESS] Refresh: 40/43 complete | 3 still refreshing (40s elapsed) [2026-08-23 02:55:07] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (45s elapsed) [2026-08-23 02:55:12] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (50s elapsed) [2026-08-23 02:55:17] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (55s elapsed) [2026-08-23 02:55:23] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (60s elapsed) [2026-08-23 02:55:28] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (65s elapsed) [2026-08-23 02:55:33] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (70s elapsed) [2026-08-23 02:55:39] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (75s elapsed) [2026-08-23 02:55:44] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (80s elapsed) [2026-08-23 02:55:49] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (85s elapsed) [2026-08-23 02:55:55] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (90s elapsed) [2026-08-23 02:56:00] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (95s elapsed) [2026-08-23 02:56:06] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (100s elapsed) [2026-08-23 02:56:11] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (105s elapsed) [2026-08-23 02:56:16] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (110s elapsed) [2026-08-23 02:56:22] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (115s elapsed) [2026-08-23 02:56:27] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (120s elapsed) [2026-08-23 02:56:32] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (125s elapsed) [2026-08-23 02:56:38] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (130s elapsed) [2026-08-23 02:56:43] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (135s elapsed) [2026-08-23 02:56:48] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (140s elapsed) [2026-08-23 02:56:54] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (145s elapsed) [2026-08-23 02:56:59] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (150s elapsed) [2026-08-23 02:57:04] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (155s elapsed) [2026-08-23 02:57:10] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (160s elapsed) [2026-08-23 02:57:15] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (165s elapsed) [2026-08-23 02:57:20] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (170s elapsed) [2026-08-23 02:57:26] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (175s elapsed) [2026-08-23 02:57:31] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (180s elapsed) [2026-08-23 02:57:36] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (185s elapsed) [2026-08-23 02:57:42] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (190s elapsed) [2026-08-23 02:57:47] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (195s elapsed) [2026-08-23 02:57:53] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (200s elapsed) [2026-08-23 02:57:58] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (205s elapsed) [2026-08-23 02:58:03] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (210s elapsed) [2026-08-23 02:58:09] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (215s elapsed) [2026-08-23 02:58:14] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (220s elapsed) [2026-08-23 02:58:20] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (225s elapsed) [2026-08-23 02:58:25] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (230s elapsed) [2026-08-23 02:58:30] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (235s elapsed) [2026-08-23 02:58:36] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (240s elapsed) [2026-08-23 02:58:41] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (245s elapsed) [2026-08-23 02:58:46] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (250s elapsed) [2026-08-23 02:58:52] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (255s elapsed) [2026-08-23 02:58:57] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (260s elapsed) [2026-08-23 02:59:03] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (265s elapsed) [2026-08-23 02:59:08] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (270s elapsed) [2026-08-23 02:59:13] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (275s elapsed) [2026-08-23 02:59:19] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (280s elapsed) [2026-08-23 02:59:24] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (285s elapsed) [2026-08-23 02:59:29] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (290s elapsed) [2026-08-23 02:59:35] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (295s elapsed) [2026-08-23 02:59:40] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (300s elapsed) [2026-08-23 02:59:46] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (305s elapsed) [2026-08-23 02:59:51] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (310s elapsed) [2026-08-23 02:59:56] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (315s elapsed) [2026-08-23 03:00:02] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (320s elapsed) [2026-08-23 03:00:07] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (325s elapsed) [2026-08-23 03:00:12] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (330s elapsed) [2026-08-23 03:00:18] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (335s elapsed) [2026-08-23 03:00:23] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (340s elapsed) [2026-08-23 03:00:28] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (345s elapsed) [2026-08-23 03:00:34] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (350s elapsed) [2026-08-23 03:00:39] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (355s elapsed) [2026-08-23 03:00:45] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (360s elapsed) [2026-08-23 03:00:50] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (365s elapsed) [2026-08-23 03:00:55] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (370s elapsed) [2026-08-23 03:01:01] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (375s elapsed) [2026-08-23 03:01:06] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (380s elapsed) [2026-08-23 03:01:11] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (385s elapsed) [2026-08-23 03:01:17] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (390s elapsed) [2026-08-23 03:01:22] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (395s elapsed) [2026-08-23 03:01:27] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (400s elapsed) [2026-08-23 03:01:33] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (405s elapsed) [2026-08-23 03:01:38] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (410s elapsed) [2026-08-23 03:01:44] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (415s elapsed) [2026-08-23 03:01:49] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (420s elapsed) [2026-08-23 03:01:54] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (425s elapsed) [2026-08-23 03:02:00] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (430s elapsed) [2026-08-23 03:02:05] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (435s elapsed) [2026-08-23 03:02:10] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (440s elapsed) [2026-08-23 03:02:16] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (445s elapsed) [2026-08-23 03:02:21] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (450s elapsed) [2026-08-23 03:02:26] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (455s elapsed) [2026-08-23 03:02:32] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (460s elapsed) [2026-08-23 03:02:37] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (465s elapsed) [2026-08-23 03:02:43] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (470s elapsed) [2026-08-23 03:02:48] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (475s elapsed) [2026-08-23 03:02:53] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (480s elapsed) [2026-08-23 03:02:59] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (485s elapsed) [2026-08-23 03:03:04] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (490s elapsed) [2026-08-23 03:03:10] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (495s elapsed) [2026-08-23 03:03:15] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (500s elapsed) [2026-08-23 03:03:20] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (505s elapsed) [2026-08-23 03:03:26] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (510s elapsed) [2026-08-23 03:03:31] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (515s elapsed) [2026-08-23 03:03:36] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (520s elapsed) [2026-08-23 03:03:42] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (525s elapsed) [2026-08-23 03:03:47] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (530s elapsed) [2026-08-23 03:03:53] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (535s elapsed) [2026-08-23 03:03:58] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (540s elapsed) [2026-08-23 03:04:03] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (545s elapsed) [2026-08-23 03:04:09] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (550s elapsed) [2026-08-23 03:04:14] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (555s elapsed) [2026-08-23 03:04:19] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (560s elapsed) [2026-08-23 03:04:25] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (565s elapsed) [2026-08-23 03:04:30] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (570s elapsed) [2026-08-23 03:04:36] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (575s elapsed) [2026-08-23 03:04:41] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (580s elapsed) [2026-08-23 03:04:46] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (585s elapsed) [2026-08-23 03:04:52] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (590s elapsed) [2026-08-23 03:04:57] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (595s elapsed) [2026-08-23 03:05:02] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (600s elapsed) [2026-08-23 03:05:08] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (605s elapsed) [2026-08-23 03:05:13] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (610s elapsed) [2026-08-23 03:05:19] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (615s elapsed) [2026-08-23 03:05:24] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (620s elapsed) [2026-08-23 03:05:29] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (625s elapsed) [2026-08-23 03:05:35] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (630s elapsed) [2026-08-23 03:05:40] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (635s elapsed) [2026-08-23 03:05:46] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (640s elapsed) [2026-08-23 03:05:51] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (645s elapsed) [2026-08-23 03:05:56] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (650s elapsed) [2026-08-23 03:06:02] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (655s elapsed) [2026-08-23 03:06:07] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (660s elapsed) [2026-08-23 03:06:12] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (665s elapsed) [2026-08-23 03:06:18] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (670s elapsed) [2026-08-23 03:06:23] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (675s elapsed) [2026-08-23 03:06:28] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (680s elapsed) [2026-08-23 03:06:34] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (685s elapsed) [2026-08-23 03:06:39] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (690s elapsed) [2026-08-23 03:06:45] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (695s elapsed) [2026-08-23 03:06:50] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (700s elapsed) [2026-08-23 03:06:55] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (705s elapsed) [2026-08-23 03:07:01] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (710s elapsed) [2026-08-23 03:07:06] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (715s elapsed) [2026-08-23 03:07:11] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (720s elapsed) [2026-08-23 03:07:17] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (725s elapsed) [2026-08-23 03:07:22] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (730s elapsed) [2026-08-23 03:07:28] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (735s elapsed) [2026-08-23 03:07:33] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (740s elapsed) [2026-08-23 03:07:38] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (745s elapsed) [2026-08-23 03:07:44] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (750s elapsed) [2026-08-23 03:07:49] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (755s elapsed) [2026-08-23 03:07:54] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (760s elapsed) [2026-08-23 03:08:00] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (765s elapsed) [2026-08-23 03:08:05] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (770s elapsed) [2026-08-23 03:08:11] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (775s elapsed) [2026-08-23 03:08:16] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (780s elapsed) [2026-08-23 03:08:21] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (785s elapsed) [2026-08-23 03:08:27] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (790s elapsed) [2026-08-23 03:08:32] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (795s elapsed) [2026-08-23 03:08:37] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (800s elapsed) [2026-08-23 03:08:43] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (805s elapsed) [2026-08-23 03:08:48] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (810s elapsed) [2026-08-23 03:08:53] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (815s elapsed) [2026-08-23 03:08:59] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (820s elapsed) [2026-08-23 03:09:04] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (825s elapsed) [2026-08-23 03:09:10] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (830s elapsed) [2026-08-23 03:09:15] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (835s elapsed) [2026-08-23 03:09:20] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (840s elapsed) [2026-08-23 03:09:26] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (845s elapsed) [2026-08-23 03:09:31] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (850s elapsed) [2026-08-23 03:09:37] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (855s elapsed) [2026-08-23 03:09:42] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (860s elapsed) [2026-08-23 03:09:47] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (865s elapsed) [2026-08-23 03:09:53] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (870s elapsed) [2026-08-23 03:09:58] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (875s elapsed) [2026-08-23 03:10:03] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (880s elapsed) [2026-08-23 03:10:09] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (885s elapsed) [2026-08-23 03:10:14] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (890s elapsed) [2026-08-23 03:10:20] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (895s elapsed) [2026-08-23 03:10:25] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (900s elapsed) [2026-08-23 03:10:30] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (905s elapsed) [2026-08-23 03:10:36] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (910s elapsed) [2026-08-23 03:10:41] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (915s elapsed) [2026-08-23 03:10:47] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (920s elapsed) [2026-08-23 03:10:52] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (925s elapsed) [2026-08-23 03:10:57] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (930s elapsed) [2026-08-23 03:11:03] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (935s elapsed) [2026-08-23 03:11:08] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (940s elapsed) [2026-08-23 03:11:13] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (945s elapsed) [2026-08-23 03:11:19] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (950s elapsed) [2026-08-23 03:11:24] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (955s elapsed) [2026-08-23 03:11:30] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (960s elapsed) [2026-08-23 03:11:35] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (965s elapsed) [2026-08-23 03:11:40] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (970s elapsed) [2026-08-23 03:11:46] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (975s elapsed) [2026-08-23 03:11:51] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (980s elapsed) [2026-08-23 03:11:57] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (985s elapsed) [2026-08-23 03:12:02] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (990s elapsed) [2026-08-23 03:12:07] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (995s elapsed) [2026-08-23 03:12:13] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (1000s elapsed) [2026-08-23 03:12:18] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (1005s elapsed) [2026-08-23 03:12:24] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (1010s elapsed) [2026-08-23 03:12:29] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (1015s elapsed) [2026-08-23 03:12:34] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (1020s elapsed) [2026-08-23 03:12:40] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (1025s elapsed) [2026-08-23 03:12:45] [SUCCESS] All 43 applications refreshed ============================================================================= [2026-08-23 03:12:45] [STEP] Waiting for all ArgoCD applications to sync and become healthy ============================================================================= [2026-08-23 03:12:45] [INFO] Timeout: 2700 seconds (45 minutes) [2026-08-23 03:12:45] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 0s elapsed) [2026-08-23 03:12:45] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:12:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:12:55] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 10s elapsed) [2026-08-23 03:12:55] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:12:55] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:13:06] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 20s elapsed) [2026-08-23 03:13:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:13:06] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:13:16] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 31s elapsed) [2026-08-23 03:13:16] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:13:16] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:13:26] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 41s elapsed) [2026-08-23 03:13:26] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:13:26] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:13:36] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 51s elapsed) [2026-08-23 03:13:36] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:13:36] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:13:46] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 1s elapsed) [2026-08-23 03:13:46] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:13:46] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:13:57] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 11s elapsed) [2026-08-23 03:13:57] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:13:57] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:14:07] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 22s elapsed) [2026-08-23 03:14:07] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:14:07] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:14:17] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 32s elapsed) [2026-08-23 03:14:17] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:14:17] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:14:27] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 42s elapsed) [2026-08-23 03:14:27] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:14:27] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:14:37] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 52s elapsed) [2026-08-23 03:14:37] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:14:37] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:14:48] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 2s elapsed) [2026-08-23 03:14:48] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:14:48] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:14:48] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:14:48] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:14:48] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:14:48] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:14:48] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:14:48] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:14:48] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:14:48] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:14:48] [INFO] │ └─ Message: No message [2026-08-23 03:14:48] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:14:58] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 13s elapsed) [2026-08-23 03:14:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:14:58] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:15:08] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 23s elapsed) [2026-08-23 03:15:08] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:15:08] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:15:19] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 33s elapsed) [2026-08-23 03:15:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:15:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:15:29] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 44s elapsed) [2026-08-23 03:15:29] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:15:29] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:15:39] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 54s elapsed) [2026-08-23 03:15:39] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:15:39] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:15:49] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 4s elapsed) [2026-08-23 03:15:49] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:15:49] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:15:59] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 14s elapsed) [2026-08-23 03:15:59] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:15:59] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:16:10] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 24s elapsed) [2026-08-23 03:16:10] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:16:10] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:16:20] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 35s elapsed) [2026-08-23 03:16:20] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:16:20] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:16:30] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 45s elapsed) [2026-08-23 03:16:30] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:16:30] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:16:40] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 55s elapsed) [2026-08-23 03:16:40] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:16:40] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:16:50] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 5s elapsed) [2026-08-23 03:16:50] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:16:50] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:16:51] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:16:51] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:16:51] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:16:51] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:16:51] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:16:51] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:16:51] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:16:51] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:16:51] [INFO] │ └─ Message: No message [2026-08-23 03:16:51] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:17:01] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 16s elapsed) [2026-08-23 03:17:01] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:17:01] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:17:11] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 26s elapsed) [2026-08-23 03:17:11] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:17:11] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:17:21] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 36s elapsed) [2026-08-23 03:17:21] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:17:21] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:17:31] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 46s elapsed) [2026-08-23 03:17:31] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:17:31] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:17:42] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 56s elapsed) [2026-08-23 03:17:42] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:17:42] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:17:52] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 7s elapsed) [2026-08-23 03:17:52] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:17:52] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:18:02] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 17s elapsed) [2026-08-23 03:18:02] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:18:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:18:12] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 27s elapsed) [2026-08-23 03:18:12] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:18:12] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:18:22] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 37s elapsed) [2026-08-23 03:18:22] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:18:22] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:18:33] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 47s elapsed) [2026-08-23 03:18:33] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:18:33] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:18:43] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 58s elapsed) [2026-08-23 03:18:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:18:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:18:53] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 8s elapsed) [2026-08-23 03:18:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:18:53] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:18:53] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:18:53] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:18:53] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:18:53] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:18:53] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:18:53] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:18:53] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:18:53] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:18:53] [INFO] │ └─ Message: No message [2026-08-23 03:18:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:19:03] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 18s elapsed) [2026-08-23 03:19:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:19:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:19:14] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 29s elapsed) [2026-08-23 03:19:14] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:19:14] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:19:24] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 39s elapsed) [2026-08-23 03:19:24] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:19:24] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:19:34] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 49s elapsed) [2026-08-23 03:19:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:19:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:19:44] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 59s elapsed) [2026-08-23 03:19:44] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:19:44] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:19:55] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 9s elapsed) [2026-08-23 03:19:55] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:19:55] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:20:05] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 20s elapsed) [2026-08-23 03:20:05] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:20:05] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:20:15] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 30s elapsed) [2026-08-23 03:20:15] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:20:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:20:25] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 40s elapsed) [2026-08-23 03:20:25] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:20:25] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:20:35] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 50s elapsed) [2026-08-23 03:20:35] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:20:35] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:20:46] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 0s elapsed) [2026-08-23 03:20:46] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:20:46] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:20:56] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 11s elapsed) [2026-08-23 03:20:56] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:20:56] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:20:56] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:20:56] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:20:56] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:20:56] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:20:56] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:20:56] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:20:56] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:20:56] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:20:56] [INFO] │ └─ Message: No message [2026-08-23 03:20:56] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:21:06] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 21s elapsed) [2026-08-23 03:21:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:21:06] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:21:16] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 31s elapsed) [2026-08-23 03:21:16] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:21:16] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:21:27] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 41s elapsed) [2026-08-23 03:21:27] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:21:27] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:21:37] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 52s elapsed) [2026-08-23 03:21:37] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:21:37] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:21:47] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 2s elapsed) [2026-08-23 03:21:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:21:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:21:57] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 12s elapsed) [2026-08-23 03:21:57] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:21:57] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:22:07] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 22s elapsed) [2026-08-23 03:22:07] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:22:07] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:22:18] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 32s elapsed) [2026-08-23 03:22:18] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:22:18] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:22:28] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 43s elapsed) [2026-08-23 03:22:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:22:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:22:38] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 53s elapsed) [2026-08-23 03:22:38] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:22:38] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:22:48] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 3s elapsed) [2026-08-23 03:22:48] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:22:48] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:22:58] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 13s elapsed) [2026-08-23 03:22:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:22:58] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:22:59] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:22:59] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:22:59] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:22:59] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:22:59] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:22:59] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:22:59] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:22:59] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:22:59] [INFO] │ └─ Message: No message [2026-08-23 03:22:59] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:23:09] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 24s elapsed) [2026-08-23 03:23:09] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:23:09] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:23:19] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 34s elapsed) [2026-08-23 03:23:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:23:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:23:29] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 44s elapsed) [2026-08-23 03:23:29] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:23:29] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:23:40] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 54s elapsed) [2026-08-23 03:23:40] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:23:40] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:23:50] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 5s elapsed) [2026-08-23 03:23:50] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:23:50] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:24:00] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 15s elapsed) [2026-08-23 03:24:00] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:24:00] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:24:10] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 25s elapsed) [2026-08-23 03:24:10] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:24:10] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:24:20] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 35s elapsed) [2026-08-23 03:24:20] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:24:20] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:24:31] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 45s elapsed) [2026-08-23 03:24:31] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:24:31] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:24:41] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 56s elapsed) [2026-08-23 03:24:41] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:24:41] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:24:51] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 6s elapsed) [2026-08-23 03:24:51] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:24:51] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:25:01] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 16s elapsed) [2026-08-23 03:25:01] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:25:01] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:25:02] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:25:02] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:25:02] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:25:02] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:25:02] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:25:02] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:25:02] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:25:02] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:25:02] [INFO] │ └─ Message: No message [2026-08-23 03:25:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:25:12] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 27s elapsed) [2026-08-23 03:25:12] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:25:12] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:25:22] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 37s elapsed) [2026-08-23 03:25:22] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:25:22] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:25:33] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 47s elapsed) [2026-08-23 03:25:33] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:25:33] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:25:43] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 58s elapsed) [2026-08-23 03:25:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:25:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:25:53] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 8s elapsed) [2026-08-23 03:25:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:25:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:26:03] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 18s elapsed) [2026-08-23 03:26:03] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:26:03] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:26:13] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 28s elapsed) [2026-08-23 03:26:13] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:26:13] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:26:24] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 38s elapsed) [2026-08-23 03:26:24] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:26:24] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:26:34] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 49s elapsed) [2026-08-23 03:26:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:26:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:26:44] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 59s elapsed) [2026-08-23 03:26:44] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:26:44] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:26:54] [PROGRESS] Applications: 43/44 ready | 1 pending (14m 9s elapsed) [2026-08-23 03:26:54] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:26:54] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:27:04] [PROGRESS] Applications: 43/44 ready | 1 pending (14m 19s elapsed) [2026-08-23 03:27:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:27:04] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:27:05] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:27:05] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:27:05] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:27:05] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:27:05] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:27:05] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:27:05] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:27:05] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:27:05] [INFO] │ └─ Message: No message [2026-08-23 03:27:05] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:27:15] [PROGRESS] Applications: 43/44 ready | 1 pending (14m 30s elapsed) [2026-08-23 03:27:15] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:27:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:27:25] [PROGRESS] Applications: 43/44 ready | 1 pending (14m 40s elapsed) [2026-08-23 03:27:25] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:27:25] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:27:35] [PROGRESS] Applications: 43/44 ready | 1 pending (14m 50s elapsed) [2026-08-23 03:27:35] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:27:35] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:27:45] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 0s elapsed) [2026-08-23 03:27:45] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:27:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:27:56] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 10s elapsed) [2026-08-23 03:27:56] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:27:56] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:28:06] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 21s elapsed) [2026-08-23 03:28:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:28:06] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:28:16] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 31s elapsed) [2026-08-23 03:28:16] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:28:16] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:28:26] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 41s elapsed) [2026-08-23 03:28:26] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:28:26] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:28:37] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 51s elapsed) [2026-08-23 03:28:37] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:28:37] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:28:47] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 2s elapsed) [2026-08-23 03:28:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:28:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:28:57] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 12s elapsed) [2026-08-23 03:28:57] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:28:57] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:29:07] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 22s elapsed) [2026-08-23 03:29:07] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:29:07] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:29:07] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:29:07] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:29:07] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:29:07] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:29:07] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:29:07] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:29:07] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:29:07] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:29:07] [INFO] │ └─ Message: No message [2026-08-23 03:29:07] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:29:18] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 32s elapsed) [2026-08-23 03:29:18] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:29:18] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:29:28] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 43s elapsed) [2026-08-23 03:29:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:29:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:29:38] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 53s elapsed) [2026-08-23 03:29:38] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:29:38] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:29:48] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 3s elapsed) [2026-08-23 03:29:48] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:29:48] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:29:58] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 13s elapsed) [2026-08-23 03:29:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:29:58] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:30:09] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 23s elapsed) [2026-08-23 03:30:09] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:30:09] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:30:19] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 34s elapsed) [2026-08-23 03:30:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:30:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:30:29] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 44s elapsed) [2026-08-23 03:30:29] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:30:29] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:30:39] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 54s elapsed) [2026-08-23 03:30:39] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:30:39] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:30:49] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 4s elapsed) [2026-08-23 03:30:49] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:30:49] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:31:00] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 14s elapsed) [2026-08-23 03:31:00] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:31:00] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:31:10] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 25s elapsed) [2026-08-23 03:31:10] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:31:10] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:31:10] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:31:10] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:31:10] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:31:10] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:31:10] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:31:10] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:31:10] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:31:10] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:31:10] [INFO] │ └─ Message: No message [2026-08-23 03:31:10] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:31:20] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 35s elapsed) [2026-08-23 03:31:20] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:31:20] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:31:31] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 45s elapsed) [2026-08-23 03:31:31] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:31:31] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:31:41] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 56s elapsed) [2026-08-23 03:31:41] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:31:41] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:31:51] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 6s elapsed) [2026-08-23 03:31:51] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:31:51] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:32:01] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 16s elapsed) [2026-08-23 03:32:01] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:32:01] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:32:11] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 26s elapsed) [2026-08-23 03:32:11] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:32:11] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:32:22] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 36s elapsed) [2026-08-23 03:32:22] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:32:22] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:32:32] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 47s elapsed) [2026-08-23 03:32:32] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:32:32] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:32:42] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 57s elapsed) [2026-08-23 03:32:42] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:32:42] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:32:52] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 7s elapsed) [2026-08-23 03:32:52] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:32:52] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:33:02] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 17s elapsed) [2026-08-23 03:33:02] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:33:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:33:13] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 27s elapsed) [2026-08-23 03:33:13] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:33:13] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:33:13] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:33:13] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:33:13] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:33:13] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:33:13] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:33:13] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:33:13] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:33:13] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:33:13] [INFO] │ └─ Message: No message [2026-08-23 03:33:13] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:33:23] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 38s elapsed) [2026-08-23 03:33:23] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:33:23] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:33:33] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 48s elapsed) [2026-08-23 03:33:33] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:33:33] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:33:43] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 58s elapsed) [2026-08-23 03:33:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:33:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:33:54] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 8s elapsed) [2026-08-23 03:33:54] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:33:54] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:34:04] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 19s elapsed) [2026-08-23 03:34:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:34:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:34:14] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 29s elapsed) [2026-08-23 03:34:14] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:34:14] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:34:24] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 39s elapsed) [2026-08-23 03:34:24] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:34:24] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:34:34] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 49s elapsed) [2026-08-23 03:34:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:34:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:34:45] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 59s elapsed) [2026-08-23 03:34:45] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:34:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:34:55] [PROGRESS] Applications: 43/44 ready | 1 pending (22m 10s elapsed) [2026-08-23 03:34:55] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:34:55] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:35:05] [PROGRESS] Applications: 43/44 ready | 1 pending (22m 20s elapsed) [2026-08-23 03:35:05] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:35:05] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:35:15] [PROGRESS] Applications: 43/44 ready | 1 pending (22m 30s elapsed) [2026-08-23 03:35:15] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:35:15] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:35:15] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:35:15] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:35:15] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:35:15] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:35:15] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:35:15] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:35:15] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:35:15] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:35:15] [INFO] │ └─ Message: No message [2026-08-23 03:35:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:35:26] [PROGRESS] Applications: 43/44 ready | 1 pending (22m 40s elapsed) [2026-08-23 03:35:26] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:35:26] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:35:36] [PROGRESS] Applications: 43/44 ready | 1 pending (22m 51s elapsed) [2026-08-23 03:35:36] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:35:36] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:35:46] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 1s elapsed) [2026-08-23 03:35:46] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:35:46] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:35:56] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 11s elapsed) [2026-08-23 03:35:56] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:35:56] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:36:07] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 21s elapsed) [2026-08-23 03:36:07] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:36:07] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:36:17] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 32s elapsed) [2026-08-23 03:36:17] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:36:17] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:36:27] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 42s elapsed) [2026-08-23 03:36:27] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:36:27] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:36:37] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 52s elapsed) [2026-08-23 03:36:37] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:36:37] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:36:47] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 2s elapsed) [2026-08-23 03:36:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:36:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:36:58] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 12s elapsed) [2026-08-23 03:36:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:36:58] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:37:08] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 23s elapsed) [2026-08-23 03:37:08] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:37:08] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:37:18] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 33s elapsed) [2026-08-23 03:37:18] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:37:18] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:37:18] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:37:18] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:37:18] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:37:18] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:37:18] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:37:18] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:37:18] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:37:18] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:37:18] [INFO] │ └─ Message: No message [2026-08-23 03:37:18] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:37:28] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 43s elapsed) [2026-08-23 03:37:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:37:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:37:39] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 53s elapsed) [2026-08-23 03:37:39] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:37:39] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:37:49] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 4s elapsed) [2026-08-23 03:37:49] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:37:49] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:37:59] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 14s elapsed) [2026-08-23 03:37:59] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:37:59] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:38:09] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 24s elapsed) [2026-08-23 03:38:09] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:38:09] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:38:19] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 34s elapsed) [2026-08-23 03:38:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:38:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:38:30] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 44s elapsed) [2026-08-23 03:38:30] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:38:30] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:38:40] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 55s elapsed) [2026-08-23 03:38:40] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:38:40] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:38:50] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 5s elapsed) [2026-08-23 03:38:50] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:38:50] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:39:00] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 15s elapsed) [2026-08-23 03:39:00] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:39:00] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:39:10] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 25s elapsed) [2026-08-23 03:39:10] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:39:10] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:39:21] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 35s elapsed) [2026-08-23 03:39:21] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:39:21] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:39:21] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:39:21] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:39:21] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:39:21] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:39:21] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:39:21] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:39:21] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:39:21] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:39:21] [INFO] │ └─ Message: No message [2026-08-23 03:39:21] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:39:31] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 46s elapsed) [2026-08-23 03:39:31] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:39:31] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:39:41] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 56s elapsed) [2026-08-23 03:39:41] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:39:41] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:39:52] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 6s elapsed) [2026-08-23 03:39:52] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:39:52] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:40:02] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 17s elapsed) [2026-08-23 03:40:02] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:40:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:40:12] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 27s elapsed) [2026-08-23 03:40:12] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:40:12] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:40:22] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 37s elapsed) [2026-08-23 03:40:22] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:40:22] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:40:32] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 47s elapsed) [2026-08-23 03:40:32] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:40:32] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:40:43] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 57s elapsed) [2026-08-23 03:40:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:40:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:40:53] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 8s elapsed) [2026-08-23 03:40:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:40:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:41:03] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 18s elapsed) [2026-08-23 03:41:03] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:41:03] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:41:13] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 28s elapsed) [2026-08-23 03:41:13] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:41:13] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:41:23] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 38s elapsed) [2026-08-23 03:41:23] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:41:23] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:41:24] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:41:24] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:41:24] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:41:24] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:41:24] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:41:24] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:41:24] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:41:24] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:41:24] [INFO] │ └─ Message: No message [2026-08-23 03:41:24] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:41:34] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 49s elapsed) [2026-08-23 03:41:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:41:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:41:44] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 59s elapsed) [2026-08-23 03:41:44] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:41:44] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:41:54] [PROGRESS] Applications: 43/44 ready | 1 pending (29m 9s elapsed) [2026-08-23 03:41:54] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:41:54] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:42:04] [PROGRESS] Applications: 43/44 ready | 1 pending (29m 19s elapsed) [2026-08-23 03:42:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:42:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:42:15] [PROGRESS] Applications: 43/44 ready | 1 pending (29m 29s elapsed) [2026-08-23 03:42:15] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:42:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:42:25] [PROGRESS] Applications: 43/44 ready | 1 pending (29m 40s elapsed) [2026-08-23 03:42:25] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:42:25] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:42:35] [PROGRESS] Applications: 43/44 ready | 1 pending (29m 50s elapsed) [2026-08-23 03:42:35] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:42:35] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:42:45] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 0s elapsed) [2026-08-23 03:42:45] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:42:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:42:55] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 10s elapsed) [2026-08-23 03:42:55] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:42:55] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:43:06] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 20s elapsed) [2026-08-23 03:43:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:43:06] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:43:16] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 31s elapsed) [2026-08-23 03:43:16] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:43:16] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:43:26] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 41s elapsed) [2026-08-23 03:43:26] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:43:26] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:43:26] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:43:26] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:43:26] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:43:26] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:43:26] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:43:26] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:43:26] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:43:26] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:43:26] [INFO] │ └─ Message: No message [2026-08-23 03:43:26] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:43:37] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 51s elapsed) [2026-08-23 03:43:37] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:43:37] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:43:47] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 2s elapsed) [2026-08-23 03:43:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:43:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:43:57] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 12s elapsed) [2026-08-23 03:43:57] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:43:57] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:44:07] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 22s elapsed) [2026-08-23 03:44:07] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:44:07] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:44:17] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 32s elapsed) [2026-08-23 03:44:17] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:44:17] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:44:28] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 42s elapsed) [2026-08-23 03:44:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:44:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:44:38] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 53s elapsed) [2026-08-23 03:44:38] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:44:38] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:44:48] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 3s elapsed) [2026-08-23 03:44:48] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:44:48] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:44:58] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 13s elapsed) [2026-08-23 03:44:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:44:58] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:45:08] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 23s elapsed) [2026-08-23 03:45:08] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:45:08] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:45:19] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 33s elapsed) [2026-08-23 03:45:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:45:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:45:29] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 44s elapsed) [2026-08-23 03:45:29] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:45:29] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:45:29] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:45:29] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:45:29] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:45:29] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:45:29] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:45:29] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:45:29] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:45:29] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:45:29] [INFO] │ └─ Message: No message [2026-08-23 03:45:29] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:45:39] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 54s elapsed) [2026-08-23 03:45:39] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:45:39] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:45:49] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 4s elapsed) [2026-08-23 03:45:49] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:45:49] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:46:00] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 14s elapsed) [2026-08-23 03:46:00] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:46:00] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:46:10] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 25s elapsed) [2026-08-23 03:46:10] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:46:10] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:46:20] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 35s elapsed) [2026-08-23 03:46:20] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:46:20] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:46:30] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 45s elapsed) [2026-08-23 03:46:30] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:46:30] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:46:40] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 55s elapsed) [2026-08-23 03:46:40] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:46:40] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:46:51] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 5s elapsed) [2026-08-23 03:46:51] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:46:51] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:47:01] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 16s elapsed) [2026-08-23 03:47:01] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:47:01] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:47:11] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 26s elapsed) [2026-08-23 03:47:11] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:47:11] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:47:21] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 36s elapsed) [2026-08-23 03:47:21] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:47:21] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:47:31] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 46s elapsed) [2026-08-23 03:47:31] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:47:31] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:47:32] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:47:32] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:47:32] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:47:32] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:47:32] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:47:32] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:47:32] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:47:32] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:47:32] [INFO] │ └─ Message: No message [2026-08-23 03:47:32] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:47:42] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 57s elapsed) [2026-08-23 03:47:42] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:47:42] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:47:52] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 7s elapsed) [2026-08-23 03:47:52] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:47:52] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:48:02] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 17s elapsed) [2026-08-23 03:48:02] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:48:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:48:13] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 27s elapsed) [2026-08-23 03:48:13] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:48:13] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:48:23] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 38s elapsed) [2026-08-23 03:48:23] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:48:23] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:48:33] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 48s elapsed) [2026-08-23 03:48:33] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:48:33] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:48:43] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 58s elapsed) [2026-08-23 03:48:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:48:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:48:53] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 8s elapsed) [2026-08-23 03:48:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:48:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:49:04] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 18s elapsed) [2026-08-23 03:49:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:49:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:49:14] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 29s elapsed) [2026-08-23 03:49:14] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:49:14] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:49:24] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 39s elapsed) [2026-08-23 03:49:24] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:49:24] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:49:34] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 49s elapsed) [2026-08-23 03:49:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:49:34] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:49:34] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:49:34] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:49:34] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:49:34] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:49:34] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:49:34] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:49:34] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:49:34] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:49:34] [INFO] │ └─ Message: No message [2026-08-23 03:49:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:49:45] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 59s elapsed) [2026-08-23 03:49:45] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:49:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:49:55] [PROGRESS] Applications: 43/44 ready | 1 pending (37m 10s elapsed) [2026-08-23 03:49:55] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:49:55] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:50:05] [PROGRESS] Applications: 43/44 ready | 1 pending (37m 20s elapsed) [2026-08-23 03:50:05] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:50:05] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:50:15] [PROGRESS] Applications: 43/44 ready | 1 pending (37m 30s elapsed) [2026-08-23 03:50:15] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:50:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:50:25] [PROGRESS] Applications: 43/44 ready | 1 pending (37m 40s elapsed) [2026-08-23 03:50:25] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:50:25] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:50:36] [PROGRESS] Applications: 43/44 ready | 1 pending (37m 50s elapsed) [2026-08-23 03:50:36] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:50:36] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:50:46] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 1s elapsed) [2026-08-23 03:50:46] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:50:46] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:50:56] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 11s elapsed) [2026-08-23 03:50:56] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:50:56] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:51:06] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 21s elapsed) [2026-08-23 03:51:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:51:06] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:51:16] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 31s elapsed) [2026-08-23 03:51:16] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:51:16] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:51:27] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 41s elapsed) [2026-08-23 03:51:27] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:51:27] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:51:37] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 52s elapsed) [2026-08-23 03:51:37] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:51:37] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:51:37] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:51:37] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:51:37] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:51:37] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:51:37] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:51:37] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:51:37] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:51:37] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:51:37] [INFO] │ └─ Message: No message [2026-08-23 03:51:37] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:51:47] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 2s elapsed) [2026-08-23 03:51:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:51:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:51:58] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 12s elapsed) [2026-08-23 03:51:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:51:58] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:52:08] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 23s elapsed) [2026-08-23 03:52:08] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:52:08] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:52:18] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 33s elapsed) [2026-08-23 03:52:18] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:52:18] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:52:28] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 43s elapsed) [2026-08-23 03:52:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:52:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:52:38] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 53s elapsed) [2026-08-23 03:52:38] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:52:38] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:52:49] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 3s elapsed) [2026-08-23 03:52:49] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:52:49] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:52:59] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 14s elapsed) [2026-08-23 03:52:59] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:52:59] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:53:09] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 24s elapsed) [2026-08-23 03:53:09] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:53:09] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:53:19] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 34s elapsed) [2026-08-23 03:53:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:53:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:53:29] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 44s elapsed) [2026-08-23 03:53:29] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:53:29] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:53:40] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 54s elapsed) [2026-08-23 03:53:40] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:53:40] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:53:40] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:53:40] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:53:40] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:53:40] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:53:40] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:53:40] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:53:40] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:53:40] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:53:40] [INFO] │ └─ Message: No message [2026-08-23 03:53:40] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:53:50] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 5s elapsed) [2026-08-23 03:53:50] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:53:50] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:54:00] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 15s elapsed) [2026-08-23 03:54:00] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:54:00] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:54:10] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 25s elapsed) [2026-08-23 03:54:10] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:54:10] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:54:21] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 35s elapsed) [2026-08-23 03:54:21] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:54:21] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:54:31] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 46s elapsed) [2026-08-23 03:54:31] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:54:31] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:54:41] [PROGRESS] Applications: 42/44 ready | 2 pending (41m 56s elapsed) [2026-08-23 03:54:41] [INFO] Pending: backup-in-cluster-local,image-rbac-proxy-in-cluster-local [2026-08-23 03:54:41] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:54:51] [PROGRESS] Applications: 42/44 ready | 2 pending (42m 6s elapsed) [2026-08-23 03:54:51] [INFO] Pending: backup-in-cluster-local,image-rbac-proxy-in-cluster-local [2026-08-23 03:54:51] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:55:02] [PROGRESS] Applications: 42/44 ready | 2 pending (42m 16s elapsed) [2026-08-23 03:55:02] [INFO] Pending: backup-in-cluster-local,image-rbac-proxy-in-cluster-local [2026-08-23 03:55:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:55:12] [PROGRESS] Applications: 43/44 ready | 1 pending (42m 27s elapsed) [2026-08-23 03:55:12] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:55:12] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:55:22] [PROGRESS] Applications: 43/44 ready | 1 pending (42m 37s elapsed) [2026-08-23 03:55:22] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:55:22] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:55:32] [PROGRESS] Applications: 43/44 ready | 1 pending (42m 47s elapsed) [2026-08-23 03:55:32] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:55:32] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:55:42] [PROGRESS] Applications: 43/44 ready | 1 pending (42m 57s elapsed) [2026-08-23 03:55:42] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:55:42] [SUBSTEP] Detailed status of pending applications: [2026-08-23 03:55:43] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 03:55:43] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 03:55:43] [INFO] │ ├─ Health Status: Degraded [2026-08-23 03:55:43] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 03:55:43] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 03:55:43] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 03:55:43] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 03:55:43] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 03:55:43] [INFO] │ └─ Message: No message [2026-08-23 03:55:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:55:53] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 8s elapsed) [2026-08-23 03:55:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:55:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:56:03] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 18s elapsed) [2026-08-23 03:56:03] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:56:03] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:56:13] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 28s elapsed) [2026-08-23 03:56:13] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:56:13] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:56:23] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 38s elapsed) [2026-08-23 03:56:23] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:56:23] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:56:34] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 48s elapsed) [2026-08-23 03:56:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:56:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:56:44] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 59s elapsed) [2026-08-23 03:56:44] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:56:44] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:56:54] [PROGRESS] Applications: 43/44 ready | 1 pending (44m 9s elapsed) [2026-08-23 03:56:54] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:56:54] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:57:04] [PROGRESS] Applications: 43/44 ready | 1 pending (44m 19s elapsed) [2026-08-23 03:57:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:57:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:57:14] [PROGRESS] Applications: 43/44 ready | 1 pending (44m 29s elapsed) [2026-08-23 03:57:14] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:57:14] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:57:25] [PROGRESS] Applications: 43/44 ready | 1 pending (44m 39s elapsed) [2026-08-23 03:57:25] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:57:25] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:57:35] [PROGRESS] Applications: 43/44 ready | 1 pending (44m 50s elapsed) [2026-08-23 03:57:35] [INFO] Pending: backup-in-cluster-local [2026-08-23 03:57:35] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 03:57:45] [ERROR] ============================================================================= [2026-08-23 03:57:45] [ERROR] TIMEOUT: Applications failed to sync within 45 minutes [2026-08-23 03:57:45] [ERROR] ============================================================================= [2026-08-23 03:57:45] [ERROR] ============================================================================= [2026-08-23 03:57:45] [ERROR] DETAILED STATUS OF ALL PENDING APPLICATIONS [2026-08-23 03:57:45] [ERROR] ============================================================================= [2026-08-23 03:57:45] [ERROR] [2026-08-23 03:57:45] [ERROR] Application: backup-in-cluster-local [2026-08-23 03:57:45] [ERROR] ----------------------------------------------------------------------------- [2026-08-23 03:57:46] [ERROR] Sync Status: OutOfSync [2026-08-23 03:57:46] [ERROR] Health Status: Degraded [2026-08-23 03:57:46] [ERROR] Repository: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-08-23 03:57:46] [ERROR] Target Revision: preview-main-irfz [2026-08-23 03:57:46] [ERROR] Conditions: [2026-08-23 03:57:46] [ERROR] Unhealthy Resources: - ConfigMap/image-repository-resource-modifier-config: Missing - no message - Secret/minio-storage-configuration: Missing - no message - Job/create-velero-bucket: Missing - no message - Tenant/oadp-minio-storage: Missing - no message - DataProtectionApplication/velero-aws: Missing - no message - Subscription/redhat-oadp-operator: Degraded - 1: CatalogSourcesUnhealthy | False 2: ResolutionFailed | True - Schedule/backup-tenants: Missing - no message [2026-08-23 03:57:47] [ERROR] Operation Message: one or more synchronization tasks completed unsuccessfully. Retrying attempt #22 at 3:59AM. [2026-08-23 03:57:47] [ERROR] ============================================================================= ============================================================================= [2026-08-23 03:57:47] [STEP] Execution Summary ============================================================================= [2026-08-23 03:57:47] [ERROR] Status: FAILED [2026-08-23 03:57:47] [ERROR] Failure Reason: ARGOCD_SYNC_TIMEOUT: 1 apps failed to sync [2026-08-23 03:57:47] [INFO] Total Execution Time: 64m 7s (3847 seconds) [2026-08-23 03:57:47] [INFO] Applications Deployed: 43 [2026-08-23 03:57:47] [ERROR] Failed Applications: backup-in-cluster-local [EXECUTION_SUMMARY_JSON] {"status":"failed","total_time_seconds":3847,"apps_deployed":43,"failure_reason":"ARGOCD_SYNC_TIMEOUT: 1 apps failed to sync","failed_apps":"backup-in-cluster-local","ocp_version":"4.18.9","preview_branch":"preview-main-irfz"} Switched to branch 'main' Your branch is up to date with 'upstream/main'. I0823 03:57:47.273986 16908 common.go:278] got an error: exit status 1 - will retry in 10s [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 60 [running]: > runtime/debug.Stack() > /usr/lib/golang/src/runtime/debug/stack.go:26 +0x5e > sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot() > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/log/log.go:60 +0xcd > sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0x25c6c5b98200, {0x34e4fa3, 0x14}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/log/deleg.go:147 +0x3e > github.com/go-logr/logr.Logger.WithName({{0x38c0b18, 0x25c6c5b98200}, 0x0}, {0x34e4fa3?, 0x0?}) > /opt/app-root/src/go/pkg/mod/github.com/go-logr/logr@v1.4.3/logr.go:345 +0x36 > sigs.k8s.io/controller-runtime/pkg/client.newClient(0x1?, {0x0, 0x25c6c5e7d0a0, {0x0, 0x0}, 0x0, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/client/client.go:118 +0xdb > sigs.k8s.io/controller-runtime/pkg/client.New(0x25c6c6258008?, {0x0, 0x25c6c5e7d0a0, {0x0, 0x0}, 0x0, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/client/client.go:98 +0x4d > github.com/konflux-ci/e2e-tests/pkg/clients/kubernetes.NewAdminKubernetesClient() > /tmp/tmp.hmcJ8gLLSW/pkg/clients/kubernetes/client.go:159 +0x90 > github.com/konflux-ci/e2e-tests/magefiles/installation.NewAppStudioInstallController() > /tmp/tmp.hmcJ8gLLSW/magefiles/installation/install.go:105 +0x31 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.InstallKonflux() > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/repos/common.go:262 +0x17 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.retry(0x385c598, 0x2, 0x2540be400) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/repos/common.go:281 +0xf8 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.init.func7(0x25c6c5b6c058?) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/repos/common.go:355 +0xae > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.ActionFunc.Execute(0x34b9524?, 0x34cc829?) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/types.go:279 +0x19 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Apply(...) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/types.go:315 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x5c974e0, 0x25c6c607ca08) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/types.go:348 +0xc2 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x5c8f780?, 0x3, 0x23ad979?}, 0x25c6c607ca08) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/types.go:245 +0x5f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x5c97600, 0x25c6c607ca08) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/types.go:340 +0x2b > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x5c99280?, 0x5, 0x43a7c5?}, 0x25c6c607ca08) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/types.go:245 +0x5f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).runLoadedCatalog(0x5cc87f0, {0x25c6c66c0788?, 0x7, 0x3510318?}, 0x25c6c607ca08) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/types.go:129 +0x11f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).RunRulesOfCategory(0x5cc87f0, {0x34b9522, 0x2}, 0x25c6c607ca08) > /tmp/tmp.hmcJ8gLLSW/magefiles/rulesengine/types.go:121 +0x2f7 > main.CI.TestE2E({}) > /tmp/tmp.hmcJ8gLLSW/magefiles/magefile.go:330 +0x1b7 > main.main.func20({0x25c6c5e87108?, 0x1e62765?}) > /tmp/tmp.hmcJ8gLLSW/magefiles/mage_output_file.go:888 +0xf > main.main.func12.1() > /tmp/tmp.hmcJ8gLLSW/magefiles/mage_output_file.go:306 +0x5b > created by main.main.func12 in goroutine 1 > /tmp/tmp.hmcJ8gLLSW/magefiles/mage_output_file.go:301 +0xbe W0823 03:57:57.277685 16908 install.go:185] folder /tmp/tmp.hmcJ8gLLSW/tmp/infra-deployments already exists... removing I0823 03:57:57.488735 16908 install.go:226] cloning 'https://github.com/redhat-appstudio/infra-deployments' (ref: 'refs/heads/main', remote: 'upstream') Enumerating objects: 92483, done. Counting objects: 0% (1/6375) Counting objects: 1% (64/6375) Counting objects: 2% (128/6375) Counting objects: 3% (192/6375) Counting objects: 4% (255/6375) Counting objects: 5% (319/6375) Counting objects: 6% (383/6375) Counting objects: 7% (447/6375) Counting objects: 8% (510/6375) Counting objects: 9% (574/6375) Counting objects: 10% (638/6375) Counting objects: 11% (702/6375) Counting objects: 12% (765/6375) Counting objects: 13% (829/6375) Counting objects: 14% (893/6375) Counting objects: 15% (957/6375) Counting objects: 16% (1020/6375) Counting objects: 17% (1084/6375) Counting objects: 18% (1148/6375) Counting objects: 19% (1212/6375) Counting objects: 20% (1275/6375) Counting objects: 21% (1339/6375) Counting objects: 22% (1403/6375) Counting objects: 23% (1467/6375) Counting objects: 24% (1530/6375) Counting objects: 25% (1594/6375) Counting objects: 26% (1658/6375) Counting objects: 27% (1722/6375) Counting objects: 28% (1785/6375) Counting objects: 29% (1849/6375) Counting objects: 30% (1913/6375) Counting objects: 31% (1977/6375) Counting objects: 32% (2040/6375) Counting objects: 33% (2104/6375) Counting objects: 34% (2168/6375) Counting objects: 35% (2232/6375) Counting objects: 36% (2295/6375) Counting objects: 37% (2359/6375) Counting objects: 38% (2423/6375) Counting objects: 39% (2487/6375) Counting objects: 40% (2550/6375) Counting objects: 41% (2614/6375) Counting objects: 42% (2678/6375) Counting objects: 43% (2742/6375) Counting objects: 44% (2805/6375) Counting objects: 45% (2869/6375) Counting objects: 46% (2933/6375) Counting objects: 47% (2997/6375) Counting objects: 48% (3060/6375) Counting objects: 49% (3124/6375) Counting objects: 50% (3188/6375) Counting objects: 51% (3252/6375) Counting objects: 52% (3315/6375) Counting objects: 53% (3379/6375) Counting objects: 54% (3443/6375) Counting objects: 55% (3507/6375) Counting objects: 56% (3570/6375) Counting objects: 57% (3634/6375) Counting objects: 58% (3698/6375) Counting objects: 59% (3762/6375) Counting objects: 60% (3825/6375) Counting objects: 61% (3889/6375) Counting objects: 62% (3953/6375) Counting objects: 63% (4017/6375) Counting objects: 64% (4080/6375) Counting objects: 65% (4144/6375) Counting objects: 66% (4208/6375) Counting objects: 67% (4272/6375) Counting objects: 68% (4335/6375) Counting objects: 69% (4399/6375) Counting objects: 70% (4463/6375) Counting objects: 71% (4527/6375) Counting objects: 72% (4590/6375) Counting objects: 73% (4654/6375) Counting objects: 74% (4718/6375) Counting objects: 75% (4782/6375) Counting objects: 76% (4845/6375) Counting objects: 77% (4909/6375) Counting objects: 78% (4973/6375) Counting objects: 79% (5037/6375) Counting objects: 80% (5100/6375) Counting objects: 81% (5164/6375) Counting objects: 82% (5228/6375) Counting objects: 83% (5292/6375) Counting objects: 84% (5355/6375) Counting objects: 85% (5419/6375) Counting objects: 86% (5483/6375) Counting objects: 87% (5547/6375) Counting objects: 88% (5610/6375) Counting objects: 89% (5674/6375) Counting objects: 90% (5738/6375) Counting objects: 91% (5802/6375) Counting objects: 92% (5865/6375) Counting objects: 93% (5929/6375) Counting objects: 94% (5993/6375) Counting objects: 95% (6057/6375) Counting objects: 96% (6120/6375) Counting objects: 97% (6184/6375) Counting objects: 98% (6248/6375) Counting objects: 99% (6312/6375) Counting objects: 100% (6375/6375) Counting objects: 100% (6375/6375), done. Compressing objects: 0% (1/305) Compressing objects: 1% (4/305) Compressing objects: 2% (7/305) Compressing objects: 3% (10/305) Compressing objects: 4% (13/305) Compressing objects: 5% (16/305) Compressing objects: 6% (19/305) Compressing objects: 7% (22/305) Compressing objects: 8% (25/305) Compressing objects: 9% (28/305) Compressing objects: 10% (31/305) Compressing objects: 11% (34/305) Compressing objects: 12% (37/305) Compressing objects: 13% (40/305) Compressing objects: 14% (43/305) Compressing objects: 15% (46/305) Compressing objects: 16% (49/305) Compressing objects: 17% (52/305) Compressing objects: 18% (55/305) Compressing objects: 19% (58/305) Compressing objects: 20% (61/305) Compressing objects: 21% (65/305) Compressing objects: 22% (68/305) Compressing objects: 23% (71/305) Compressing objects: 24% (74/305) Compressing objects: 25% (77/305) Compressing objects: 26% (80/305) Compressing objects: 27% (83/305) Compressing objects: 28% (86/305) Compressing objects: 29% (89/305) Compressing objects: 30% (92/305) Compressing objects: 31% (95/305) Compressing objects: 32% (98/305) Compressing objects: 33% (101/305) Compressing objects: 34% (104/305) Compressing objects: 35% (107/305) Compressing objects: 36% (110/305) Compressing objects: 37% (113/305) Compressing objects: 38% (116/305) Compressing objects: 39% (119/305) Compressing objects: 40% (122/305) Compressing objects: 41% (126/305) Compressing objects: 42% (129/305) Compressing objects: 43% (132/305) Compressing objects: 44% (135/305) Compressing objects: 45% (138/305) Compressing objects: 46% (141/305) Compressing objects: 47% (144/305) Compressing objects: 48% (147/305) Compressing objects: 49% (150/305) Compressing objects: 50% (153/305) Compressing objects: 51% (156/305) Compressing objects: 52% (159/305) Compressing objects: 53% (162/305) Compressing objects: 54% (165/305) Compressing objects: 55% (168/305) Compressing objects: 56% (171/305) Compressing objects: 57% (174/305) Compressing objects: 58% (177/305) Compressing objects: 59% (180/305) Compressing objects: 60% (183/305) Compressing objects: 61% (187/305) Compressing objects: 62% (190/305) Compressing objects: 63% (193/305) Compressing objects: 64% (196/305) Compressing objects: 65% (199/305) Compressing objects: 66% (202/305) Compressing objects: 67% (205/305) Compressing objects: 68% (208/305) Compressing objects: 69% (211/305) Compressing objects: 70% (214/305) Compressing objects: 71% (217/305) Compressing objects: 72% (220/305) Compressing objects: 73% (223/305) Compressing objects: 74% (226/305) Compressing objects: 75% (229/305) Compressing objects: 76% (232/305) Compressing objects: 77% (235/305) Compressing objects: 78% (238/305) Compressing objects: 79% (241/305) Compressing objects: 80% (244/305) Compressing objects: 81% (248/305) Compressing objects: 82% (251/305) Compressing objects: 83% (254/305) Compressing objects: 84% (257/305) Compressing objects: 85% (260/305) Compressing objects: 86% (263/305) Compressing objects: 87% (266/305) Compressing objects: 88% (269/305) Compressing objects: 89% (272/305) Compressing objects: 90% (275/305) Compressing objects: 91% (278/305) Compressing objects: 92% (281/305) Compressing objects: 93% (284/305) Compressing objects: 94% (287/305) Compressing objects: 95% (290/305) Compressing objects: 96% (293/305) Compressing objects: 97% (296/305) Compressing objects: 98% (299/305) Compressing objects: 99% (302/305) Compressing objects: 100% (305/305) Compressing objects: 100% (305/305), done. Total 92483 (delta 6160), reused 6072 (delta 6070), pack-reused 86108 (from 2) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. ============================================================================= [2026-08-23 03:58:03] [STEP] Starting Konflux Cluster Bootstrap ============================================================================= [2026-08-23 03:58:03] [INFO] Mode: preview [2026-08-23 03:58:03] [INFO] Options: OBO=disabled, EAAS=disabled, OPERATOR_OVERLAY=disabled [2026-08-23 03:58:03] [INFO] Start time: 2026-08-23 03:58:03 UTC ============================================================================= [2026-08-23 03:58:03] [STEP] Phase 1: Deploying ArgoCD ============================================================================= ============================================================================= [2026-08-23 03:58:03] [STEP] Deploying OpenShift GitOps (ArgoCD) ============================================================================= [2026-08-23 03:58:03] [SUBSTEP] Verifying cluster-admin permissions [2026-08-23 03:58:03] [SUCCESS] User 'cluster-admin' has cluster-admin permissions [2026-08-23 03:58:03] [SUBSTEP] Installing OpenShift GitOps operator subscription clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller unchanged clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server unchanged clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller unchanged clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server unchanged subscription.operators.coreos.com/openshift-gitops-operator unchanged [2026-08-23 03:58:04] [SUCCESS] GitOps operator subscription applied [2026-08-23 03:58:04] [SUBSTEP] Waiting for default ArgoCD project to be created [2026-08-23 03:58:04] [SUCCESS] Default ArgoCD project is available [2026-08-23 03:58:04] [SUBSTEP] Waiting for OpenShift GitOps route to be created [2026-08-23 03:58:05] [SUCCESS] OpenShift GitOps route is available [2026-08-23 03:58:05] [SUBSTEP] Configuring ArgoCD repo server resources and timeout argocd.argoproj.io/openshift-gitops patched (no change) [2026-08-23 03:58:05] [SUCCESS] Repo server configured: timeout=5m, cpu=100m, memory=100Mi [2026-08-23 03:58:05] [SUBSTEP] Configuring ArgoCD application controller resources argocd.argoproj.io/openshift-gitops patched (no change) [2026-08-23 03:58:05] [SUCCESS] Application controller configured: cpu=4, memory=4Gi [2026-08-23 03:58:05] [SUBSTEP] Switching ArgoCD route to re-encryption TLS argocd.argoproj.io/openshift-gitops patched (no change) [2026-08-23 03:58:05] [SUCCESS] Route TLS termination set to 'reencrypt' [2026-08-23 03:58:05] [SUBSTEP] Restarting ArgoCD server after TLS configuration change pod "openshift-gitops-server-598965b464-rvz9w" deleted [2026-08-23 03:58:06] [SUCCESS] ArgoCD server pods deleted for restart [2026-08-23 03:58:06] [SUBSTEP] Granting admin role to authenticated users [2026-08-23 03:58:06] [INFO] Note: This should be updated once proper access policy is in place argocd.argoproj.io/openshift-gitops patched (no change) [2026-08-23 03:58:06] [SUCCESS] RBAC policy set: system:authenticated -> role:admin [2026-08-23 03:58:06] [SUBSTEP] Configuring PVC health check (WaitForFirstConsumer workaround) Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) [2026-08-23 03:58:06] [SUCCESS] PVC health customization applied (Pending/Bound = Healthy) [2026-08-23 03:58:06] [SUBSTEP] Enabling Helm support in Kustomize builds argocd.argoproj.io/openshift-gitops patched (no change) [2026-08-23 03:58:06] [SUCCESS] Kustomize build options set: --enable-helm [2026-08-23 03:58:07] [SUBSTEP] Configuring ArgoCD to ignore aggregated roles in diff argocd.argoproj.io/openshift-gitops patched (no change) [2026-08-23 03:58:07] [SUCCESS] ignoreAggregatedRoles set to true [2026-08-23 03:58:07] [SUBSTEP] Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched (no change) [2026-08-23 03:58:07] [SUCCESS] Resource tracking method set to 'annotation' [2026-08-23 03:58:07] [SUBSTEP] Restarting GitOps server deployment deployment.apps/openshift-gitops-server restarted [2026-08-23 03:58:07] [SUCCESS] GitOps server restart initiated [2026-08-23 03:58:07] [INFO] Waiting for rollout to complete... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... deployment "openshift-gitops-server" successfully rolled out [2026-08-23 03:58:38] [SUCCESS] GitOps server rollout complete ============================================================================= [2026-08-23 03:58:38] [STEP] ArgoCD Access Information ============================================================================= [2026-08-23 03:58:38] [INFO] ArgoCD URL: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com [2026-08-23 03:58:38] [INFO] Authentication: Use 'Login with OpenShift' button (OpenShift credentials) [2026-08-23 03:58:38] [SUBSTEP] Verifying ArgoCD route is accessible [2026-08-23 03:58:58] [WAITING] Waiting for route to respond (5s/120s) [2026-08-23 03:59:03] [SUCCESS] ArgoCD is accessible at https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com [ARGOCD_DEPLOY_JSON] {"status":"success","url":"https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com","namespace":"openshift-gitops","auth_method":"openshift"} ============================================================================= [2026-08-23 03:59:03] [STEP] OpenShift GitOps Deployment Complete ============================================================================= ============================================================================= [2026-08-23 03:59:03] [STEP] Phase 2: Bootstrapping Host Cluster ============================================================================= [2026-08-23 03:59:03] [INFO] Bootstrapping host cluster components [2026-08-23 03:59:03] [INFO] No preview.env file found - using environment variables only [2026-08-23 03:59:03] [SUCCESS] Host cluster bootstrap complete ============================================================================= [2026-08-23 03:59:03] [STEP] Phase 3: Bootstrapping Member Cluster ============================================================================= [2026-08-23 03:59:03] [INFO] Bootstrapping member cluster components [2026-08-23 03:59:03] [INFO] No preview.env file found - using environment variables only [2026-08-23 03:59:03] [SUBSTEP] Configuring Pipeline Service secrets Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation product-kubearchive-logging namespace already exists, skipping creation Creating DB secret DB secret already exists, skipping creation Creating S3 secret S3 secret already exists, skipping creation Creating S3 secret S3 secret already exists, skipping creation Creating Postgres TLS certs Postgres DB cert secret already exists, skipping creation [2026-08-23 03:59:04] [SUCCESS] Pipeline Service secrets configured [2026-08-23 03:59:04] [SUBSTEP] Configuring GitHub secrets [2026-08-23 03:59:04] [INFO] GitHub token provided - creating secrets namespace/application-service configured Creating a has secret from legacy token secret/has-github-token configured [2026-08-23 03:59:05] [SUCCESS] GitHub secrets configured [2026-08-23 03:59:05] [SUBSTEP] Configuring Image Controller secrets [2026-08-23 03:59:05] [INFO] Quay organization: redhat-appstudio-qe Creating a secret with a token for Image Controller namespace/image-controller configured secret/quaytoken configured [2026-08-23 03:59:07] [SUCCESS] Image Controller secrets configured [2026-08-23 03:59:07] [SUCCESS] Member cluster bootstrap complete ============================================================================= [2026-08-23 03:59:07] [STEP] Phase 4: Bootstrapping Common Components ============================================================================= [2026-08-23 03:59:07] [INFO] Bootstrapping common cluster components [2026-08-23 03:59:07] [INFO] No preview.env file found at /tmp/tmp.hmcJ8gLLSW/tmp/infra-deployments/hack/../hack/preview.env - using environment variables only [2026-08-23 03:59:07] [SUBSTEP] Configuring Docker Hub pull secret Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.NwZ6tnclbe secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.NwZ6tnclbe secret/docker-io-pull configured [2026-08-23 03:59:08] [SUCCESS] Docker Hub pull secret configured [2026-08-23 03:59:08] [SUCCESS] Common cluster bootstrap complete ============================================================================= [2026-08-23 03:59:08] [STEP] Phase 5: Mode-Specific Deployment (preview) ============================================================================= [2026-08-23 03:59:08] [INFO] Deploying preview configuration ============================================================================= [2026-08-23 03:59:08] [STEP] Starting Konflux Preview Environment Setup ============================================================================= [2026-08-23 03:59:08] [INFO] Script: /tmp/tmp.hmcJ8gLLSW/tmp/infra-deployments/hack/../hack/preview.sh [2026-08-23 03:59:08] [INFO] Options: OBO=false, GRAFANA=false, EAAS=false, OVERLAY=development [2026-08-23 03:59:08] [INFO] Start time: 2026-08-23 03:59:08 UTC ============================================================================= [2026-08-23 03:59:08] [STEP] Cluster Context Information ============================================================================= [2026-08-23 03:59:09] [INFO] OpenShift Version: 4.18.9 [2026-08-23 03:59:09] [INFO] API Server: https://api.kx-71ec122d0a.s901.p3.openshiftapps.com:443 [2026-08-23 03:59:09] [INFO] Cluster ID: a460bb25-ec92-4abe-a1de-9ac2096aadc7 [2026-08-23 03:59:09] [INFO] Cluster Domain: apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com [2026-08-23 03:59:09] [INFO] Total Nodes: 3 [2026-08-23 03:59:10] [INFO] - Master nodes: 0 [2026-08-23 03:59:10] [INFO] - Worker nodes: 3 [2026-08-23 03:59:10] [SUCCESS] Cluster operators: All healthy [CLUSTER_CONTEXT_JSON] {"ocp_version":"4.18.9","api_server":"https://api.kx-71ec122d0a.s901.p3.openshiftapps.com:443","cluster_id":"a460bb25-ec92-4abe-a1de-9ac2096aadc7","cluster_domain":"apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com","total_nodes":3,"master_nodes":0,"worker_nodes":3,"degraded_operators":0} Switched to a new branch 'preview-main-pbpm' [2026-08-23 03:59:10] [SUCCESS] Git environment initialized [2026-08-23 03:59:10] [INFO] - Repository URL: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-08-23 03:59:10] [INFO] - Source branch: main [2026-08-23 03:59:10] [INFO] - Preview branch: preview-main-pbpm [2026-08-23 03:59:10] [INFO] - GitHub org: redhat-appstudio-qe ============================================================================= [2026-08-23 03:59:10] [STEP] Patching ArgoCD application manifests to use fork repository ============================================================================= [2026-08-23 03:59:10] [INFO] Setting repoURL to: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-08-23 03:59:10] [INFO] Setting targetRevision to: preview-main-pbpm [2026-08-23 03:59:10] [SUBSTEP] Patched: application-patch.yaml [2026-08-23 03:59:10] [SUBSTEP] Patched: application-set-patch.yaml [2026-08-23 03:59:10] [SUBSTEP] Patched: application-set-multisrc-src-1-patch.yaml [2026-08-23 03:59:10] [SUCCESS] All ArgoCD patch files updated ============================================================================= [2026-08-23 03:59:10] [STEP] Labeling cluster nodes for Konflux workloads ============================================================================= [2026-08-23 03:59:10] [INFO] Reference: https://github.com/redhat-appstudio/infra-deployments/pull/4415 [2026-08-23 03:59:10] [INFO] Found 3 nodes to label with 'konflux-ci.dev/workload=konflux-tenants' [2026-08-23 03:59:10] [SUBSTEP] Labeling node/ip-10-0-138-172.ec2.internal node/ip-10-0-138-172.ec2.internal not labeled [2026-08-23 03:59:10] [SUCCESS] Successfully labeled node/ip-10-0-138-172.ec2.internal [2026-08-23 03:59:10] [SUBSTEP] Labeling node/ip-10-0-151-60.ec2.internal node/ip-10-0-151-60.ec2.internal not labeled [2026-08-23 03:59:10] [SUCCESS] Successfully labeled node/ip-10-0-151-60.ec2.internal [2026-08-23 03:59:10] [SUBSTEP] Labeling node/ip-10-0-160-33.ec2.internal node/ip-10-0-160-33.ec2.internal not labeled [2026-08-23 03:59:11] [SUCCESS] Successfully labeled node/ip-10-0-160-33.ec2.internal [2026-08-23 03:59:11] [SUBSTEP] Verifying labels on all nodes... [2026-08-23 03:59:11] [SUCCESS] All 3 nodes labeled and verified successfully ============================================================================= [2026-08-23 03:59:11] [STEP] Checking OCP version for Kueue compatibility ============================================================================= [2026-08-23 03:59:11] [INFO] Detected OpenShift Container Platform version: 4.18.9 (minor: 18) [2026-08-23 03:59:11] [SUCCESS] OCP version 4.18.9 meets Kueue requirements - Kueue will be deployed ============================================================================= [2026-08-23 03:59:11] [STEP] Configuring GitHub organization ============================================================================= [2026-08-23 03:59:11] [INFO] Setting GitHub org to: redhat-appstudio-qe [2026-08-23 03:59:11] [INFO] Configuring GitHub organization for Application Service (HAS) [2026-08-23 03:59:11] [INFO] - Target org: redhat-appstudio-qe [2026-08-23 03:59:11] [INFO] - Config file: /tmp/tmp.hmcJ8gLLSW/tmp/infra-deployments/hack/../components/has/base/kustomization.yaml [2026-08-23 03:59:11] [SUCCESS] GitHub organization set to 'redhat-appstudio-qe' [2026-08-23 03:59:11] [SUCCESS] Verified: Configuration updated correctly [2026-08-23 03:59:11] [SUCCESS] GitHub organization configured ============================================================================= [2026-08-23 03:59:11] [STEP] Configuring Rekor server hostname ============================================================================= [2026-08-23 03:59:11] [INFO] Cluster domain: apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com [2026-08-23 03:59:11] [INFO] Rekor server hostname: rekor.apps.rosa.kx-71ec122d0a.s901.p3.openshiftapps.com [2026-08-23 03:59:11] [SUCCESS] Rekor server hostname configured ============================================================================= [2026-08-23 03:59:11] [STEP] Applying service image overrides from environment variables ============================================================================= [2026-08-23 03:59:11] [INFO] No service image overrides configured - using default images ============================================================================= [2026-08-23 03:59:11] [STEP] Committing and pushing preview changes ============================================================================= [preview-main-pbpm 45dba282f] Preview mode, do not merge into main 8 files changed, 15 insertions(+), 19 deletions(-) remote: remote: Create a pull request for 'preview-main-pbpm' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-pbpm remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-pbpm -> preview-main-pbpm branch 'preview-main-pbpm' set up to track 'qe/preview-main-pbpm'. [2026-08-23 03:59:13] [SUCCESS] Preview changes committed and pushed to qe/preview-main-pbpm ============================================================================= [2026-08-23 03:59:13] [STEP] Deploying ArgoCD applications ============================================================================= [2026-08-23 03:59:13] [SUBSTEP] Applying root Application from: /tmp/tmp.hmcJ8gLLSW/tmp/infra-deployments/hack/../argo-cd-apps/app-of-app-sets/development application.argoproj.io/all-application-sets configured [2026-08-23 03:59:13] [SUCCESS] Root Application 'all-application-sets' created [2026-08-23 03:59:13] [SUBSTEP] Waiting for 'all-application-sets' to become Healthy and Synced [2026-08-23 03:59:14] [SUCCESS] Root application 'all-application-sets' is Healthy and Synced [2026-08-23 03:59:14] [SUBSTEP] Triggering hard refresh on all ArgoCD applications [2026-08-23 03:59:14] [INFO] Found 44 applications to refresh application.argoproj.io/release-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/has-in-cluster-local patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/monitoring-registry-in-cluster-local patched application.argoproj.io/konflux-info-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/postgres patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/smee-client-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/monitoring-workload-custom-kube-state-metrics-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/konflux-verifications-rd-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/backup-in-cluster-local patched application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/dummy-deployment-in-cluster-local patched application.argoproj.io/disaster-recovery-in-cluster-local patched application.argoproj.io/image-rbac-proxy-in-cluster-local patched [2026-08-23 03:59:23] [SUCCESS] Hard refresh triggered on all 44 applications [2026-08-23 03:59:23] [SUBSTEP] Waiting for refresh operations to complete [2026-08-23 03:59:24] [PROGRESS] Refresh: 4/44 complete | 40 still refreshing (5s elapsed) [2026-08-23 03:59:29] [PROGRESS] Refresh: 12/44 complete | 32 still refreshing (10s elapsed) [2026-08-23 03:59:35] [PROGRESS] Refresh: 29/44 complete | 15 still refreshing (15s elapsed) [2026-08-23 03:59:40] [PROGRESS] Refresh: 37/44 complete | 7 still refreshing (20s elapsed) [2026-08-23 03:59:45] [PROGRESS] Refresh: 41/44 complete | 3 still refreshing (25s elapsed) [2026-08-23 03:59:51] [PROGRESS] Refresh: 41/44 complete | 3 still refreshing (30s elapsed) [2026-08-23 03:59:56] [PROGRESS] Refresh: 41/44 complete | 3 still refreshing (35s elapsed) [2026-08-23 04:00:01] [PROGRESS] Refresh: 41/44 complete | 3 still refreshing (40s elapsed) [2026-08-23 04:00:07] [PROGRESS] Refresh: 42/44 complete | 2 still refreshing (45s elapsed) [2026-08-23 04:00:12] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (50s elapsed) [2026-08-23 04:00:17] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (55s elapsed) [2026-08-23 04:00:23] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (60s elapsed) [2026-08-23 04:00:28] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (65s elapsed) [2026-08-23 04:00:34] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (70s elapsed) [2026-08-23 04:00:39] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (75s elapsed) [2026-08-23 04:00:44] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (80s elapsed) [2026-08-23 04:00:50] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (85s elapsed) [2026-08-23 04:00:55] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (90s elapsed) [2026-08-23 04:01:00] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (95s elapsed) [2026-08-23 04:01:06] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (100s elapsed) [2026-08-23 04:01:11] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (105s elapsed) [2026-08-23 04:01:17] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (110s elapsed) [2026-08-23 04:01:22] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (115s elapsed) [2026-08-23 04:01:27] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (120s elapsed) [2026-08-23 04:01:33] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (125s elapsed) [2026-08-23 04:01:38] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (130s elapsed) [2026-08-23 04:01:43] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (135s elapsed) [2026-08-23 04:01:49] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (140s elapsed) [2026-08-23 04:01:54] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (145s elapsed) [2026-08-23 04:01:59] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (150s elapsed) [2026-08-23 04:02:05] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (155s elapsed) [2026-08-23 04:02:10] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (160s elapsed) [2026-08-23 04:02:15] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (165s elapsed) [2026-08-23 04:02:21] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (170s elapsed) [2026-08-23 04:02:26] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (175s elapsed) [2026-08-23 04:02:32] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (180s elapsed) [2026-08-23 04:02:37] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (185s elapsed) [2026-08-23 04:02:42] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (190s elapsed) [2026-08-23 04:02:48] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (195s elapsed) [2026-08-23 04:02:53] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (200s elapsed) [2026-08-23 04:02:58] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (205s elapsed) [2026-08-23 04:03:04] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (210s elapsed) [2026-08-23 04:03:09] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (215s elapsed) [2026-08-23 04:03:14] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (220s elapsed) [2026-08-23 04:03:20] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (225s elapsed) [2026-08-23 04:03:25] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (230s elapsed) [2026-08-23 04:03:31] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (235s elapsed) [2026-08-23 04:03:36] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (240s elapsed) [2026-08-23 04:03:41] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (245s elapsed) [2026-08-23 04:03:47] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (250s elapsed) [2026-08-23 04:03:52] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (255s elapsed) [2026-08-23 04:03:57] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (260s elapsed) [2026-08-23 04:04:03] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (265s elapsed) [2026-08-23 04:04:08] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (270s elapsed) [2026-08-23 04:04:14] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (275s elapsed) [2026-08-23 04:04:19] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (280s elapsed) [2026-08-23 04:04:24] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (285s elapsed) [2026-08-23 04:04:30] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (290s elapsed) [2026-08-23 04:04:35] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (295s elapsed) [2026-08-23 04:04:40] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (300s elapsed) [2026-08-23 04:04:46] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (305s elapsed) [2026-08-23 04:04:51] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (310s elapsed) [2026-08-23 04:04:56] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (315s elapsed) [2026-08-23 04:05:02] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (320s elapsed) [2026-08-23 04:05:07] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (325s elapsed) [2026-08-23 04:05:13] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (330s elapsed) [2026-08-23 04:05:18] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (335s elapsed) [2026-08-23 04:05:23] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (340s elapsed) [2026-08-23 04:05:29] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (345s elapsed) [2026-08-23 04:05:34] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (350s elapsed) [2026-08-23 04:05:39] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (355s elapsed) [2026-08-23 04:05:45] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (360s elapsed) [2026-08-23 04:05:50] [SUCCESS] All 44 applications refreshed ============================================================================= [2026-08-23 04:05:50] [STEP] Waiting for all ArgoCD applications to sync and become healthy ============================================================================= [2026-08-23 04:05:50] [INFO] Timeout: 2700 seconds (45 minutes) [2026-08-23 04:05:50] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 0s elapsed) [2026-08-23 04:05:50] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:05:50] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:06:00] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 10s elapsed) [2026-08-23 04:06:00] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:06:01] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:06:11] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 21s elapsed) [2026-08-23 04:06:11] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:06:11] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:06:21] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 31s elapsed) [2026-08-23 04:06:21] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:06:21] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:06:31] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 41s elapsed) [2026-08-23 04:06:31] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:06:31] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:06:41] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 51s elapsed) [2026-08-23 04:06:41] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:06:41] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:06:52] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 1s elapsed) [2026-08-23 04:06:52] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:06:52] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:07:02] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 12s elapsed) [2026-08-23 04:07:02] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:07:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:07:12] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 22s elapsed) [2026-08-23 04:07:12] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:07:12] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:07:22] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 32s elapsed) [2026-08-23 04:07:22] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:07:22] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:07:32] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 42s elapsed) [2026-08-23 04:07:32] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:07:32] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:07:43] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 52s elapsed) [2026-08-23 04:07:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:07:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:07:53] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 3s elapsed) [2026-08-23 04:07:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:07:53] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:07:53] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:07:53] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:07:53] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:07:53] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:07:53] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:07:53] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:07:53] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:07:53] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:07:53] [INFO] │ └─ Message: No message [2026-08-23 04:07:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:08:03] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 13s elapsed) [2026-08-23 04:08:03] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:08:03] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:08:13] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 23s elapsed) [2026-08-23 04:08:13] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:08:13] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:08:24] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 33s elapsed) [2026-08-23 04:08:24] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:08:24] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:08:34] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 44s elapsed) [2026-08-23 04:08:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:08:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:08:44] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 54s elapsed) [2026-08-23 04:08:44] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:08:44] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:08:54] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 4s elapsed) [2026-08-23 04:08:54] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:08:54] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:09:04] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 14s elapsed) [2026-08-23 04:09:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:09:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:09:15] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 24s elapsed) [2026-08-23 04:09:15] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:09:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:09:25] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 35s elapsed) [2026-08-23 04:09:25] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:09:25] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:09:35] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 45s elapsed) [2026-08-23 04:09:35] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:09:35] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:09:45] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 55s elapsed) [2026-08-23 04:09:45] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:09:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:09:55] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 5s elapsed) [2026-08-23 04:09:55] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:09:55] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:09:56] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:09:56] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:09:56] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:09:56] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:09:56] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:09:56] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:09:56] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:09:56] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:09:56] [INFO] │ └─ Message: No message [2026-08-23 04:09:56] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:10:06] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 16s elapsed) [2026-08-23 04:10:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:10:06] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:10:16] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 26s elapsed) [2026-08-23 04:10:16] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:10:16] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:10:26] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 36s elapsed) [2026-08-23 04:10:26] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:10:26] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:10:37] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 46s elapsed) [2026-08-23 04:10:37] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:10:37] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:10:47] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 57s elapsed) [2026-08-23 04:10:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:10:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:10:57] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 7s elapsed) [2026-08-23 04:10:57] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:10:57] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:11:07] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 17s elapsed) [2026-08-23 04:11:07] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:11:07] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:11:17] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 27s elapsed) [2026-08-23 04:11:17] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:11:17] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:11:28] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 37s elapsed) [2026-08-23 04:11:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:11:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:11:38] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 48s elapsed) [2026-08-23 04:11:38] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:11:38] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:11:48] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 58s elapsed) [2026-08-23 04:11:48] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:11:48] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:11:58] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 8s elapsed) [2026-08-23 04:11:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:11:58] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:11:58] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:11:58] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:11:58] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:11:58] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:11:58] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:11:58] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:11:58] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:11:58] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:11:58] [INFO] │ └─ Message: No message [2026-08-23 04:11:58] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:12:09] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 18s elapsed) [2026-08-23 04:12:09] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:12:09] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:12:19] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 29s elapsed) [2026-08-23 04:12:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:12:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:12:29] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 39s elapsed) [2026-08-23 04:12:29] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:12:29] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:12:39] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 49s elapsed) [2026-08-23 04:12:39] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:12:39] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:12:50] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 59s elapsed) [2026-08-23 04:12:50] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:12:50] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:13:00] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 10s elapsed) [2026-08-23 04:13:00] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:13:00] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:13:10] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 20s elapsed) [2026-08-23 04:13:10] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:13:10] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:13:20] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 30s elapsed) [2026-08-23 04:13:20] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:13:20] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:13:30] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 40s elapsed) [2026-08-23 04:13:30] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:13:30] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:13:41] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 50s elapsed) [2026-08-23 04:13:41] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:13:41] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:13:51] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 1s elapsed) [2026-08-23 04:13:51] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:13:51] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:14:01] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 11s elapsed) [2026-08-23 04:14:01] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:14:01] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:14:01] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:14:01] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:14:01] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:14:01] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:14:01] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:14:01] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:14:01] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:14:01] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:14:01] [INFO] │ └─ Message: No message [2026-08-23 04:14:01] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:14:11] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 21s elapsed) [2026-08-23 04:14:11] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:14:11] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:14:22] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 31s elapsed) [2026-08-23 04:14:22] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:14:22] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:14:32] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 42s elapsed) [2026-08-23 04:14:32] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:14:32] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:14:42] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 52s elapsed) [2026-08-23 04:14:42] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:14:42] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:14:52] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 2s elapsed) [2026-08-23 04:14:52] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:14:52] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:15:02] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 12s elapsed) [2026-08-23 04:15:02] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:15:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:15:13] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 22s elapsed) [2026-08-23 04:15:13] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:15:13] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:15:23] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 33s elapsed) [2026-08-23 04:15:23] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:15:23] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:15:33] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 43s elapsed) [2026-08-23 04:15:33] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:15:33] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:15:43] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 53s elapsed) [2026-08-23 04:15:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:15:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:15:53] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 3s elapsed) [2026-08-23 04:15:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:15:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:16:04] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 13s elapsed) [2026-08-23 04:16:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:16:04] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:16:04] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:16:04] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:16:04] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:16:04] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:16:04] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:16:04] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:16:04] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:16:04] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:16:04] [INFO] │ └─ Message: No message [2026-08-23 04:16:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:16:14] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 24s elapsed) [2026-08-23 04:16:14] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:16:14] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:16:24] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 34s elapsed) [2026-08-23 04:16:24] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:16:24] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:16:35] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 44s elapsed) [2026-08-23 04:16:35] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:16:35] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:16:45] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 55s elapsed) [2026-08-23 04:16:45] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:16:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:16:55] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 5s elapsed) [2026-08-23 04:16:55] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:16:55] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:17:05] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 15s elapsed) [2026-08-23 04:17:05] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:17:05] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:17:15] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 25s elapsed) [2026-08-23 04:17:15] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:17:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:17:26] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 35s elapsed) [2026-08-23 04:17:26] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:17:26] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:17:36] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 46s elapsed) [2026-08-23 04:17:36] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:17:36] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:17:46] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 56s elapsed) [2026-08-23 04:17:46] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:17:46] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:17:56] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 6s elapsed) [2026-08-23 04:17:56] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:17:56] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:18:06] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 16s elapsed) [2026-08-23 04:18:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:18:06] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:18:07] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:18:07] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:18:07] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:18:07] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:18:07] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:18:07] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:18:07] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:18:07] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:18:07] [INFO] │ └─ Message: No message [2026-08-23 04:18:07] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:18:17] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 27s elapsed) [2026-08-23 04:18:17] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:18:17] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:18:27] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 37s elapsed) [2026-08-23 04:18:27] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:18:27] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:18:37] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 47s elapsed) [2026-08-23 04:18:37] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:18:37] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:18:47] [PROGRESS] Applications: 43/44 ready | 1 pending (12m 57s elapsed) [2026-08-23 04:18:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:18:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:18:58] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 7s elapsed) [2026-08-23 04:18:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:18:58] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:19:08] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 18s elapsed) [2026-08-23 04:19:08] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:19:08] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:19:18] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 28s elapsed) [2026-08-23 04:19:18] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:19:18] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:19:28] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 38s elapsed) [2026-08-23 04:19:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:19:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:19:38] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 48s elapsed) [2026-08-23 04:19:38] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:19:38] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:19:49] [PROGRESS] Applications: 43/44 ready | 1 pending (13m 58s elapsed) [2026-08-23 04:19:49] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:19:49] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:19:59] [PROGRESS] Applications: 43/44 ready | 1 pending (14m 9s elapsed) [2026-08-23 04:19:59] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:19:59] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:20:09] [PROGRESS] Applications: 43/44 ready | 1 pending (14m 19s elapsed) [2026-08-23 04:20:09] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:20:09] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:20:09] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:20:09] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:20:09] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:20:09] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:20:09] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:20:09] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:20:09] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:20:09] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:20:09] [INFO] │ └─ Message: No message [2026-08-23 04:20:09] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:20:19] [PROGRESS] Applications: 43/44 ready | 1 pending (14m 29s elapsed) [2026-08-23 04:20:20] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:20:20] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:20:30] [PROGRESS] Applications: 43/44 ready | 1 pending (14m 40s elapsed) [2026-08-23 04:20:30] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:20:30] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:20:40] [PROGRESS] Applications: 43/44 ready | 1 pending (14m 50s elapsed) [2026-08-23 04:20:40] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:20:40] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:20:50] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 0s elapsed) [2026-08-23 04:20:50] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:20:50] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:21:00] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 10s elapsed) [2026-08-23 04:21:00] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:21:00] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:21:11] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 20s elapsed) [2026-08-23 04:21:11] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:21:11] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:21:21] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 31s elapsed) [2026-08-23 04:21:21] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:21:21] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:21:31] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 41s elapsed) [2026-08-23 04:21:31] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:21:31] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:21:41] [PROGRESS] Applications: 43/44 ready | 1 pending (15m 51s elapsed) [2026-08-23 04:21:41] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:21:41] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:21:51] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 1s elapsed) [2026-08-23 04:21:51] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:21:51] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:22:02] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 11s elapsed) [2026-08-23 04:22:02] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:22:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:22:12] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 22s elapsed) [2026-08-23 04:22:12] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:22:12] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:22:12] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:22:12] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:22:12] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:22:12] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:22:12] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:22:12] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:22:12] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:22:12] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:22:12] [INFO] │ └─ Message: No message [2026-08-23 04:22:12] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:22:22] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 32s elapsed) [2026-08-23 04:22:22] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:22:22] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:22:32] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 42s elapsed) [2026-08-23 04:22:32] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:22:32] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:22:43] [PROGRESS] Applications: 43/44 ready | 1 pending (16m 52s elapsed) [2026-08-23 04:22:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:22:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:22:53] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 3s elapsed) [2026-08-23 04:22:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:22:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:23:03] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 13s elapsed) [2026-08-23 04:23:03] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:23:03] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:23:13] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 23s elapsed) [2026-08-23 04:23:13] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:23:13] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:23:23] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 33s elapsed) [2026-08-23 04:23:23] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:23:23] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:23:34] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 43s elapsed) [2026-08-23 04:23:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:23:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:23:44] [PROGRESS] Applications: 43/44 ready | 1 pending (17m 54s elapsed) [2026-08-23 04:23:44] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:23:44] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:23:54] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 4s elapsed) [2026-08-23 04:23:54] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:23:54] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:24:04] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 14s elapsed) [2026-08-23 04:24:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:24:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:24:14] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 24s elapsed) [2026-08-23 04:24:14] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:24:14] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:24:15] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:24:15] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:24:15] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:24:15] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:24:15] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:24:15] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:24:15] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:24:15] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:24:15] [INFO] │ └─ Message: No message [2026-08-23 04:24:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:24:25] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 35s elapsed) [2026-08-23 04:24:25] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:24:25] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:24:35] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 45s elapsed) [2026-08-23 04:24:35] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:24:35] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:24:45] [PROGRESS] Applications: 43/44 ready | 1 pending (18m 55s elapsed) [2026-08-23 04:24:45] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:24:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:24:56] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 5s elapsed) [2026-08-23 04:24:56] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:24:56] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:25:06] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 16s elapsed) [2026-08-23 04:25:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:25:06] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:25:16] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 26s elapsed) [2026-08-23 04:25:16] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:25:16] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:25:26] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 36s elapsed) [2026-08-23 04:25:26] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:25:26] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:25:36] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 46s elapsed) [2026-08-23 04:25:36] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:25:36] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:25:47] [PROGRESS] Applications: 43/44 ready | 1 pending (19m 56s elapsed) [2026-08-23 04:25:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:25:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:25:57] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 7s elapsed) [2026-08-23 04:25:57] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:25:57] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:26:07] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 17s elapsed) [2026-08-23 04:26:07] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:26:07] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:26:17] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 27s elapsed) [2026-08-23 04:26:17] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:26:17] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:26:17] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:26:17] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:26:17] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:26:17] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:26:17] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:26:17] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:26:17] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:26:17] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:26:17] [INFO] │ └─ Message: No message [2026-08-23 04:26:17] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:26:28] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 37s elapsed) [2026-08-23 04:26:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:26:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:26:38] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 48s elapsed) [2026-08-23 04:26:38] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:26:38] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:26:48] [PROGRESS] Applications: 43/44 ready | 1 pending (20m 58s elapsed) [2026-08-23 04:26:48] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:26:48] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:26:58] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 8s elapsed) [2026-08-23 04:26:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:26:58] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:27:08] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 18s elapsed) [2026-08-23 04:27:08] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:27:08] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:27:19] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 28s elapsed) [2026-08-23 04:27:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:27:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:27:29] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 39s elapsed) [2026-08-23 04:27:29] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:27:29] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:27:39] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 49s elapsed) [2026-08-23 04:27:39] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:27:39] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:27:49] [PROGRESS] Applications: 43/44 ready | 1 pending (21m 59s elapsed) [2026-08-23 04:27:49] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:27:49] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:27:59] [PROGRESS] Applications: 43/44 ready | 1 pending (22m 9s elapsed) [2026-08-23 04:27:59] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:27:59] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:28:10] [PROGRESS] Applications: 43/44 ready | 1 pending (22m 19s elapsed) [2026-08-23 04:28:10] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:28:10] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:28:20] [PROGRESS] Applications: 43/44 ready | 1 pending (22m 30s elapsed) [2026-08-23 04:28:20] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:28:20] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:28:20] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:28:20] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:28:20] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:28:20] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:28:20] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:28:20] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:28:20] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:28:20] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:28:20] [INFO] │ └─ Message: No message [2026-08-23 04:28:20] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:28:30] [PROGRESS] Applications: 43/44 ready | 1 pending (22m 40s elapsed) [2026-08-23 04:28:30] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:28:30] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:28:41] [PROGRESS] Applications: 43/44 ready | 1 pending (22m 50s elapsed) [2026-08-23 04:28:41] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:28:41] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:28:51] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 1s elapsed) [2026-08-23 04:28:51] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:28:51] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:29:01] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 11s elapsed) [2026-08-23 04:29:01] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:29:01] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:29:11] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 21s elapsed) [2026-08-23 04:29:11] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:29:11] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:29:21] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 31s elapsed) [2026-08-23 04:29:21] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:29:21] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:29:32] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 41s elapsed) [2026-08-23 04:29:32] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:29:32] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:29:42] [PROGRESS] Applications: 43/44 ready | 1 pending (23m 52s elapsed) [2026-08-23 04:29:42] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:29:42] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:29:52] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 2s elapsed) [2026-08-23 04:29:52] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:29:52] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:30:02] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 12s elapsed) [2026-08-23 04:30:02] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:30:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:30:12] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 22s elapsed) [2026-08-23 04:30:12] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:30:12] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:30:23] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 32s elapsed) [2026-08-23 04:30:23] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:30:23] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:30:23] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:30:23] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:30:23] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:30:23] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:30:23] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:30:23] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:30:23] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:30:23] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:30:23] [INFO] │ └─ Message: No message [2026-08-23 04:30:23] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:30:33] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 43s elapsed) [2026-08-23 04:30:33] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:30:33] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:30:43] [PROGRESS] Applications: 43/44 ready | 1 pending (24m 53s elapsed) [2026-08-23 04:30:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:30:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:30:53] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 3s elapsed) [2026-08-23 04:30:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:30:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:31:04] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 13s elapsed) [2026-08-23 04:31:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:31:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:31:14] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 24s elapsed) [2026-08-23 04:31:14] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:31:14] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:31:24] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 34s elapsed) [2026-08-23 04:31:24] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:31:24] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:31:34] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 44s elapsed) [2026-08-23 04:31:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:31:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:31:45] [PROGRESS] Applications: 43/44 ready | 1 pending (25m 54s elapsed) [2026-08-23 04:31:45] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:31:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:31:55] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 5s elapsed) [2026-08-23 04:31:55] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:31:55] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:32:05] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 15s elapsed) [2026-08-23 04:32:05] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:32:05] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:32:15] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 25s elapsed) [2026-08-23 04:32:15] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:32:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:32:25] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 35s elapsed) [2026-08-23 04:32:25] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:32:25] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:32:26] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:32:26] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:32:26] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:32:26] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:32:26] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:32:26] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:32:26] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:32:26] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:32:26] [INFO] │ └─ Message: No message [2026-08-23 04:32:26] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:32:36] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 46s elapsed) [2026-08-23 04:32:36] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:32:36] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:32:46] [PROGRESS] Applications: 43/44 ready | 1 pending (26m 56s elapsed) [2026-08-23 04:32:46] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:32:46] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:32:56] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 6s elapsed) [2026-08-23 04:32:56] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:32:56] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:33:06] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 16s elapsed) [2026-08-23 04:33:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:33:06] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:33:17] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 26s elapsed) [2026-08-23 04:33:17] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:33:17] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:33:27] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 37s elapsed) [2026-08-23 04:33:27] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:33:27] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:33:37] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 47s elapsed) [2026-08-23 04:33:37] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:33:37] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:33:47] [PROGRESS] Applications: 43/44 ready | 1 pending (27m 57s elapsed) [2026-08-23 04:33:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:33:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:33:58] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 7s elapsed) [2026-08-23 04:33:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:33:58] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:34:08] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 18s elapsed) [2026-08-23 04:34:08] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:34:08] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:34:18] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 28s elapsed) [2026-08-23 04:34:18] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:34:18] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:34:28] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 38s elapsed) [2026-08-23 04:34:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:34:28] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:34:28] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:34:28] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:34:28] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:34:28] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:34:28] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:34:28] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:34:28] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:34:28] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:34:28] [INFO] │ └─ Message: No message [2026-08-23 04:34:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:34:39] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 48s elapsed) [2026-08-23 04:34:39] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:34:39] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:34:49] [PROGRESS] Applications: 43/44 ready | 1 pending (28m 59s elapsed) [2026-08-23 04:34:49] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:34:49] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:34:59] [PROGRESS] Applications: 43/44 ready | 1 pending (29m 9s elapsed) [2026-08-23 04:34:59] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:34:59] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:35:09] [PROGRESS] Applications: 43/44 ready | 1 pending (29m 19s elapsed) [2026-08-23 04:35:09] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:35:09] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:35:19] [PROGRESS] Applications: 43/44 ready | 1 pending (29m 29s elapsed) [2026-08-23 04:35:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:35:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:35:30] [PROGRESS] Applications: 43/44 ready | 1 pending (29m 39s elapsed) [2026-08-23 04:35:30] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:35:30] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:35:40] [PROGRESS] Applications: 43/44 ready | 1 pending (29m 50s elapsed) [2026-08-23 04:35:40] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:35:40] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:35:50] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 0s elapsed) [2026-08-23 04:35:50] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:35:50] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:36:00] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 10s elapsed) [2026-08-23 04:36:00] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:36:00] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:36:10] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 20s elapsed) [2026-08-23 04:36:10] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:36:10] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:36:21] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 30s elapsed) [2026-08-23 04:36:21] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:36:21] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:36:31] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 41s elapsed) [2026-08-23 04:36:31] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:36:31] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:36:31] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:36:31] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:36:31] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:36:31] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:36:31] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:36:31] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:36:31] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:36:31] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:36:31] [INFO] │ └─ Message: No message [2026-08-23 04:36:31] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:36:41] [PROGRESS] Applications: 43/44 ready | 1 pending (30m 51s elapsed) [2026-08-23 04:36:41] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:36:41] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:36:52] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 1s elapsed) [2026-08-23 04:36:52] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:36:52] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:37:02] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 12s elapsed) [2026-08-23 04:37:02] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:37:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:37:12] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 22s elapsed) [2026-08-23 04:37:12] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:37:12] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:37:22] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 32s elapsed) [2026-08-23 04:37:22] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:37:22] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:37:32] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 42s elapsed) [2026-08-23 04:37:32] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:37:32] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:37:43] [PROGRESS] Applications: 43/44 ready | 1 pending (31m 52s elapsed) [2026-08-23 04:37:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:37:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:37:53] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 3s elapsed) [2026-08-23 04:37:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:37:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:38:03] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 13s elapsed) [2026-08-23 04:38:03] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:38:03] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:38:13] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 23s elapsed) [2026-08-23 04:38:13] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:38:13] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:38:23] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 33s elapsed) [2026-08-23 04:38:23] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:38:23] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:38:34] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 43s elapsed) [2026-08-23 04:38:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:38:34] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:38:34] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:38:34] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:38:34] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:38:34] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:38:34] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:38:34] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:38:34] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:38:34] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:38:34] [INFO] │ └─ Message: No message [2026-08-23 04:38:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:38:44] [PROGRESS] Applications: 43/44 ready | 1 pending (32m 54s elapsed) [2026-08-23 04:38:44] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:38:44] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:38:54] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 4s elapsed) [2026-08-23 04:38:54] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:38:54] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:39:04] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 14s elapsed) [2026-08-23 04:39:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:39:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:39:15] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 24s elapsed) [2026-08-23 04:39:15] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:39:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:39:25] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 35s elapsed) [2026-08-23 04:39:25] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:39:25] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:39:35] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 45s elapsed) [2026-08-23 04:39:35] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:39:35] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:39:45] [PROGRESS] Applications: 43/44 ready | 1 pending (33m 55s elapsed) [2026-08-23 04:39:45] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:39:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:39:55] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 5s elapsed) [2026-08-23 04:39:55] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:39:55] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:40:06] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 15s elapsed) [2026-08-23 04:40:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:40:06] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:40:16] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 26s elapsed) [2026-08-23 04:40:16] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:40:16] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:40:26] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 36s elapsed) [2026-08-23 04:40:26] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:40:26] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:40:36] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 46s elapsed) [2026-08-23 04:40:36] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:40:36] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:40:36] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:40:36] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:40:36] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:40:36] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:40:36] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:40:36] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:40:36] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:40:36] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:40:36] [INFO] │ └─ Message: No message [2026-08-23 04:40:36] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:40:47] [PROGRESS] Applications: 43/44 ready | 1 pending (34m 56s elapsed) [2026-08-23 04:40:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:40:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:40:57] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 7s elapsed) [2026-08-23 04:40:57] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:40:57] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:41:07] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 17s elapsed) [2026-08-23 04:41:07] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:41:07] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:41:17] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 27s elapsed) [2026-08-23 04:41:17] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:41:17] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:41:28] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 37s elapsed) [2026-08-23 04:41:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:41:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:41:38] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 48s elapsed) [2026-08-23 04:41:38] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:41:38] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:41:48] [PROGRESS] Applications: 43/44 ready | 1 pending (35m 58s elapsed) [2026-08-23 04:41:48] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:41:48] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:41:58] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 8s elapsed) [2026-08-23 04:41:58] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:41:58] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:42:08] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 18s elapsed) [2026-08-23 04:42:08] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:42:08] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:42:19] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 28s elapsed) [2026-08-23 04:42:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:42:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:42:29] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 39s elapsed) [2026-08-23 04:42:29] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:42:29] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:42:39] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 49s elapsed) [2026-08-23 04:42:39] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:42:39] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:42:39] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:42:39] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:42:39] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:42:39] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:42:39] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:42:39] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:42:39] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:42:39] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:42:39] [INFO] │ └─ Message: No message [2026-08-23 04:42:39] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:42:49] [PROGRESS] Applications: 43/44 ready | 1 pending (36m 59s elapsed) [2026-08-23 04:42:49] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:42:49] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:43:00] [PROGRESS] Applications: 43/44 ready | 1 pending (37m 9s elapsed) [2026-08-23 04:43:00] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:43:00] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:43:10] [PROGRESS] Applications: 43/44 ready | 1 pending (37m 20s elapsed) [2026-08-23 04:43:10] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:43:10] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:43:20] [PROGRESS] Applications: 43/44 ready | 1 pending (37m 30s elapsed) [2026-08-23 04:43:20] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:43:20] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:43:30] [PROGRESS] Applications: 43/44 ready | 1 pending (37m 40s elapsed) [2026-08-23 04:43:30] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:43:30] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:43:40] [PROGRESS] Applications: 43/44 ready | 1 pending (37m 50s elapsed) [2026-08-23 04:43:40] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:43:40] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:43:51] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 0s elapsed) [2026-08-23 04:43:51] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:43:51] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:44:01] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 11s elapsed) [2026-08-23 04:44:01] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:44:01] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:44:11] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 21s elapsed) [2026-08-23 04:44:11] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:44:11] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:44:21] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 31s elapsed) [2026-08-23 04:44:21] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:44:21] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:44:31] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 41s elapsed) [2026-08-23 04:44:31] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:44:31] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:44:42] [PROGRESS] Applications: 43/44 ready | 1 pending (38m 51s elapsed) [2026-08-23 04:44:42] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:44:42] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:44:42] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:44:42] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:44:42] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:44:42] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:44:42] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:44:42] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:44:42] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:44:42] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:44:42] [INFO] │ └─ Message: No message [2026-08-23 04:44:42] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:44:52] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 2s elapsed) [2026-08-23 04:44:52] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:44:52] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:45:02] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 12s elapsed) [2026-08-23 04:45:02] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:45:02] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:45:13] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 22s elapsed) [2026-08-23 04:45:13] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:45:13] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:45:23] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 33s elapsed) [2026-08-23 04:45:23] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:45:23] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:45:33] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 43s elapsed) [2026-08-23 04:45:33] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:45:33] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:45:43] [PROGRESS] Applications: 43/44 ready | 1 pending (39m 53s elapsed) [2026-08-23 04:45:43] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:45:43] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:45:53] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 3s elapsed) [2026-08-23 04:45:53] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:45:53] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:46:04] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 13s elapsed) [2026-08-23 04:46:04] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:46:04] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:46:14] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 24s elapsed) [2026-08-23 04:46:14] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:46:14] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:46:24] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 34s elapsed) [2026-08-23 04:46:24] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:46:24] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:46:34] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 44s elapsed) [2026-08-23 04:46:34] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:46:34] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:46:44] [PROGRESS] Applications: 43/44 ready | 1 pending (40m 54s elapsed) [2026-08-23 04:46:44] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:46:44] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:46:45] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:46:45] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:46:45] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:46:45] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:46:45] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:46:45] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:46:45] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:46:45] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:46:45] [INFO] │ └─ Message: No message [2026-08-23 04:46:45] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:46:55] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 5s elapsed) [2026-08-23 04:46:55] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:46:55] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:47:05] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 15s elapsed) [2026-08-23 04:47:05] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:47:05] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:47:15] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 25s elapsed) [2026-08-23 04:47:15] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:47:15] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:47:25] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 35s elapsed) [2026-08-23 04:47:25] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:47:25] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:47:36] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 45s elapsed) [2026-08-23 04:47:36] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:47:36] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:47:46] [PROGRESS] Applications: 43/44 ready | 1 pending (41m 56s elapsed) [2026-08-23 04:47:46] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:47:46] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:47:56] [PROGRESS] Applications: 43/44 ready | 1 pending (42m 6s elapsed) [2026-08-23 04:47:56] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:47:56] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:48:06] [PROGRESS] Applications: 43/44 ready | 1 pending (42m 16s elapsed) [2026-08-23 04:48:06] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:48:06] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:48:16] [PROGRESS] Applications: 43/44 ready | 1 pending (42m 26s elapsed) [2026-08-23 04:48:16] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:48:16] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:48:27] [PROGRESS] Applications: 43/44 ready | 1 pending (42m 36s elapsed) [2026-08-23 04:48:27] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:48:27] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:48:37] [PROGRESS] Applications: 43/44 ready | 1 pending (42m 47s elapsed) [2026-08-23 04:48:37] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:48:37] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:48:47] [PROGRESS] Applications: 43/44 ready | 1 pending (42m 57s elapsed) [2026-08-23 04:48:47] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:48:47] [SUBSTEP] Detailed status of pending applications: [2026-08-23 04:48:47] [INFO] ├─ App: backup-in-cluster-local [2026-08-23 04:48:47] [INFO] │ ├─ Sync Status: OutOfSync [2026-08-23 04:48:47] [INFO] │ ├─ Health Status: Degraded [2026-08-23 04:48:47] [INFO] │ ├─ Out-of-sync resources: 6 [2026-08-23 04:48:47] [WARN] │ ├─ Degraded/Missing resources: [2026-08-23 04:48:47] [WARN] │ │ └─ ConfigMap/image-repository-resource-modifier-config: Missing [2026-08-23 04:48:47] [WARN] │ │ └─ Secret/minio-storage-configuration: Missing [2026-08-23 04:48:47] [WARN] │ │ └─ Job/create-velero-bucket: Missing [2026-08-23 04:48:47] [INFO] │ └─ Message: No message [2026-08-23 04:48:47] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:48:57] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 7s elapsed) [2026-08-23 04:48:57] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:48:57] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:49:08] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 17s elapsed) [2026-08-23 04:49:08] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:49:08] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:49:18] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 28s elapsed) [2026-08-23 04:49:18] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:49:18] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:49:28] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 38s elapsed) [2026-08-23 04:49:28] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:49:28] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:49:38] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 48s elapsed) [2026-08-23 04:49:38] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:49:38] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:49:49] [PROGRESS] Applications: 43/44 ready | 1 pending (43m 58s elapsed) [2026-08-23 04:49:49] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:49:49] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:49:59] [PROGRESS] Applications: 43/44 ready | 1 pending (44m 9s elapsed) [2026-08-23 04:49:59] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:49:59] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:50:09] [PROGRESS] Applications: 43/44 ready | 1 pending (44m 19s elapsed) [2026-08-23 04:50:09] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:50:09] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:50:19] [PROGRESS] Applications: 43/44 ready | 1 pending (44m 29s elapsed) [2026-08-23 04:50:19] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:50:19] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:50:29] [PROGRESS] Applications: 43/44 ready | 1 pending (44m 39s elapsed) [2026-08-23 04:50:29] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:50:29] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:50:40] [PROGRESS] Applications: 43/44 ready | 1 pending (44m 49s elapsed) [2026-08-23 04:50:40] [INFO] Pending: backup-in-cluster-local [2026-08-23 04:50:40] [WAITING] Waiting 10 seconds before next sync check... [2026-08-23 04:50:50] [ERROR] ============================================================================= [2026-08-23 04:50:50] [ERROR] TIMEOUT: Applications failed to sync within 45 minutes [2026-08-23 04:50:50] [ERROR] ============================================================================= [2026-08-23 04:50:50] [ERROR] ============================================================================= [2026-08-23 04:50:50] [ERROR] DETAILED STATUS OF ALL PENDING APPLICATIONS [2026-08-23 04:50:50] [ERROR] ============================================================================= [2026-08-23 04:50:50] [ERROR] [2026-08-23 04:50:50] [ERROR] Application: backup-in-cluster-local [2026-08-23 04:50:50] [ERROR] ----------------------------------------------------------------------------- [2026-08-23 04:50:51] [ERROR] Sync Status: OutOfSync [2026-08-23 04:50:51] [ERROR] Health Status: Degraded [2026-08-23 04:50:51] [ERROR] Repository: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-08-23 04:50:51] [ERROR] Target Revision: preview-main-pbpm [2026-08-23 04:50:51] [ERROR] Conditions: [2026-08-23 04:50:51] [ERROR] Unhealthy Resources: - ConfigMap/image-repository-resource-modifier-config: Missing - no message - Secret/minio-storage-configuration: Missing - no message - Job/create-velero-bucket: Missing - no message - Tenant/oadp-minio-storage: Missing - no message - DataProtectionApplication/velero-aws: Missing - no message - Subscription/redhat-oadp-operator: Degraded - 1: CatalogSourcesUnhealthy | False 2: ResolutionFailed | True - Schedule/backup-tenants: Missing - no message [2026-08-23 04:50:51] [ERROR] Operation Message: one or more synchronization tasks completed unsuccessfully. Retrying attempt #39 at 4:52AM. [2026-08-23 04:50:51] [ERROR] ============================================================================= ============================================================================= [2026-08-23 04:50:51] [STEP] Execution Summary ============================================================================= [2026-08-23 04:50:51] [ERROR] Status: FAILED [2026-08-23 04:50:51] [ERROR] Failure Reason: ARGOCD_SYNC_TIMEOUT: 1 apps failed to sync [2026-08-23 04:50:51] [INFO] Total Execution Time: 51m 43s (3103 seconds) [2026-08-23 04:50:51] [INFO] Applications Deployed: 43 [2026-08-23 04:50:51] [ERROR] Failed Applications: backup-in-cluster-local [EXECUTION_SUMMARY_JSON] {"status":"failed","total_time_seconds":3103,"apps_deployed":43,"failure_reason":"ARGOCD_SYNC_TIMEOUT: 1 apps failed to sync","failed_apps":"backup-in-cluster-local","ocp_version":"4.18.9","preview_branch":"preview-main-pbpm"} Switched to branch 'main' Your branch is up to date with 'upstream/main'. Error: reached maximum number of attempts (2). error: exit status 1 make: *** [Makefile:25: ci/test/e2e] Error 1