./mage -v ci:teste2e go: downloading google.golang.org/genproto/googleapis/api v0.0.0-20260504160031-60b97b32f348 go: downloading google.golang.org/grpc v1.79.3 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20260427160629-7cedc36a6bc4 Running target: CI:TestE2E I0505 11:16:57.226895 21451 magefile.go:525] setting up new custom bundle for testing... I0505 11:16:57.534958 21451 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777979817-upxj -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: docker-build to image I0505 11:16:58.746612 21451 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777979817-upxj: quay.io/redhat-appstudio-qe/test-images@sha256:2c03a7b9ca282b72aeb841727681d892adf55e5ec158651206fe54ce081432a8 I0505 11:16:58.746642 21451 magefile.go:531] To use the custom docker bundle locally, run below cmd: export CUSTOM_DOCKER_BUILD_PIPELINE_BUNDLE=quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777979817-upxj I0505 11:16:58.746682 21451 e2e_repo.go:347] checking if repository is e2e-tests I0505 11:16:58.746690 21451 e2e_repo.go:335] multi-platform tests and require sprayproxy registering are set to TRUE exec: git "diff" "--name-status" "upstream/main..HEAD" I0505 11:16:58.750250 21451 util.go:451] The following files, go.mod, go.sum, were changed! exec: go "install" "-mod=mod" "github.com/onsi/ginkgo/v2/ginkgo" go: downloading github.com/google/pprof v0.0.0-20260115054156-294ebfa9ad83 go: downloading github.com/go-task/slim-sprig/v3 v3.0.0 I0505 11:17:01.998892 21451 install.go:226] cloning 'https://github.com/redhat-appstudio/infra-deployments' (ref: 'refs/heads/main', remote: 'upstream') Enumerating objects: 80366, done. Counting objects: 1% (1/62) Counting objects: 3% (2/62) Counting objects: 4% (3/62) Counting objects: 6% (4/62) Counting objects: 8% (5/62) Counting objects: 9% (6/62) Counting objects: 11% (7/62) Counting objects: 12% (8/62) Counting objects: 14% (9/62) Counting objects: 16% (10/62) Counting objects: 17% (11/62) Counting objects: 19% (12/62) Counting objects: 20% (13/62) Counting objects: 22% (14/62) Counting objects: 24% (15/62) Counting objects: 25% (16/62) Counting objects: 27% (17/62) Counting objects: 29% (18/62) Counting objects: 30% (19/62) Counting objects: 32% (20/62) Counting objects: 33% (21/62) Counting objects: 35% (22/62) Counting objects: 37% (23/62) Counting objects: 38% (24/62) Counting objects: 40% (25/62) Counting objects: 41% (26/62) Counting objects: 43% (27/62) Counting objects: 45% (28/62) Counting objects: 46% (29/62) Counting objects: 48% (30/62) Counting objects: 50% (31/62) Counting objects: 51% (32/62) Counting objects: 53% (33/62) Counting objects: 54% (34/62) Counting objects: 56% (35/62) Counting objects: 58% (36/62) Counting objects: 59% (37/62) Counting objects: 61% (38/62) Counting objects: 62% (39/62) Counting objects: 64% (40/62) Counting objects: 66% (41/62) Counting objects: 67% (42/62) Counting objects: 69% (43/62) Counting objects: 70% (44/62) Counting objects: 72% (45/62) Counting objects: 74% (46/62) Counting objects: 75% (47/62) Counting objects: 77% (48/62) Counting objects: 79% (49/62) Counting objects: 80% (50/62) Counting objects: 82% (51/62) Counting objects: 83% (52/62) Counting objects: 85% (53/62) Counting objects: 87% (54/62) Counting objects: 88% (55/62) Counting objects: 90% (56/62) Counting objects: 91% (57/62) Counting objects: 93% (58/62) Counting objects: 95% (59/62) Counting objects: 96% (60/62) Counting objects: 98% (61/62) Counting objects: 100% (62/62) Counting objects: 100% (62/62), done. Compressing objects: 3% (1/33) Compressing objects: 6% (2/33) Compressing objects: 9% (3/33) Compressing objects: 12% (4/33) Compressing objects: 15% (5/33) Compressing objects: 18% (6/33) Compressing objects: 21% (7/33) Compressing objects: 24% (8/33) Compressing objects: 27% (9/33) Compressing objects: 30% (10/33) Compressing objects: 33% (11/33) Compressing objects: 36% (12/33) Compressing objects: 39% (13/33) Compressing objects: 42% (14/33) Compressing objects: 45% (15/33) Compressing objects: 48% (16/33) Compressing objects: 51% (17/33) Compressing objects: 54% (18/33) Compressing objects: 57% (19/33) Compressing objects: 60% (20/33) Compressing objects: 63% (21/33) Compressing objects: 66% (22/33) Compressing objects: 69% (23/33) Compressing objects: 72% (24/33) Compressing objects: 75% (25/33) Compressing objects: 78% (26/33) Compressing objects: 81% (27/33) Compressing objects: 84% (28/33) Compressing objects: 87% (29/33) Compressing objects: 90% (30/33) Compressing objects: 93% (31/33) Compressing objects: 96% (32/33) Compressing objects: 100% (33/33) Compressing objects: 100% (33/33), done. Total 80366 (delta 50), reused 29 (delta 29), pack-reused 80304 (from 2) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. ============================================================================= [2026-05-05 11:17:06] [STEP] Starting Konflux Cluster Bootstrap ============================================================================= [2026-05-05 11:17:06] [INFO] Mode: preview [2026-05-05 11:17:06] [INFO] Options: OBO=disabled, EAAS=disabled [2026-05-05 11:17:06] [INFO] Start time: 2026-05-05 11:17:06 UTC ============================================================================= [2026-05-05 11:17:06] [STEP] Phase 1: Deploying ArgoCD ============================================================================= ============================================================================= [2026-05-05 11:17:06] [STEP] Deploying OpenShift GitOps (ArgoCD) ============================================================================= [2026-05-05 11:17:06] [SUBSTEP] Verifying cluster-admin permissions [2026-05-05 11:17:06] [SUCCESS] User 'cluster-admin' has cluster-admin permissions [2026-05-05 11:17:06] [SUBSTEP] Installing OpenShift GitOps operator subscription clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created subscription.operators.coreos.com/openshift-gitops-operator created [2026-05-05 11:17:07] [SUCCESS] GitOps operator subscription applied [2026-05-05 11:17:07] [SUBSTEP] Waiting for default ArgoCD project to be created [2026-05-05 11:17:07] [WAITING] Default project not yet available (5s/300s) [2026-05-05 11:17:12] [WAITING] Default project not yet available (10s/300s) [2026-05-05 11:17:17] [WAITING] Default project not yet available (15s/300s) [2026-05-05 11:17:22] [WAITING] Default project not yet available (20s/300s) [2026-05-05 11:17:27] [WAITING] Default project not yet available (25s/300s) [2026-05-05 11:17:33] [WAITING] Default project not yet available (30s/300s) [2026-05-05 11:17:38] [WAITING] Default project not yet available (35s/300s) [2026-05-05 11:17:43] [SUCCESS] Default ArgoCD project is available [2026-05-05 11:17:43] [SUBSTEP] Waiting for OpenShift GitOps route to be created [2026-05-05 11:17:43] [SUCCESS] OpenShift GitOps route is available [2026-05-05 11:17:43] [SUBSTEP] Configuring ArgoCD repo server resources and timeout argocd.argoproj.io/openshift-gitops patched [2026-05-05 11:17:43] [SUCCESS] Repo server configured: timeout=5m, cpu=100m, memory=100Mi [2026-05-05 11:17:43] [SUBSTEP] Configuring ArgoCD application controller resources argocd.argoproj.io/openshift-gitops patched [2026-05-05 11:17:43] [SUCCESS] Application controller configured: cpu=4, memory=4Gi [2026-05-05 11:17:43] [SUBSTEP] Switching ArgoCD route to re-encryption TLS argocd.argoproj.io/openshift-gitops patched [2026-05-05 11:17:43] [SUCCESS] Route TLS termination set to 'reencrypt' [2026-05-05 11:17:43] [SUBSTEP] Restarting ArgoCD server after TLS configuration change pod "openshift-gitops-server-6944966b75-k7qxv" deleted [2026-05-05 11:17:44] [SUCCESS] ArgoCD server pods deleted for restart [2026-05-05 11:17:44] [SUBSTEP] Granting admin role to authenticated users [2026-05-05 11:17:44] [INFO] Note: This should be updated once proper access policy is in place argocd.argoproj.io/openshift-gitops patched [2026-05-05 11:17:44] [SUCCESS] RBAC policy set: system:authenticated -> role:admin [2026-05-05 11:17:44] [SUBSTEP] Configuring PVC health check (WaitForFirstConsumer workaround) Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) [2026-05-05 11:17:44] [SUCCESS] PVC health customization applied (Pending/Bound = Healthy) [2026-05-05 11:17:44] [SUBSTEP] Enabling Helm support in Kustomize builds argocd.argoproj.io/openshift-gitops patched [2026-05-05 11:17:45] [SUCCESS] Kustomize build options set: --enable-helm [2026-05-05 11:17:45] [SUBSTEP] Configuring ArgoCD to ignore aggregated roles in diff argocd.argoproj.io/openshift-gitops patched [2026-05-05 11:17:45] [SUCCESS] ignoreAggregatedRoles set to true [2026-05-05 11:17:45] [SUBSTEP] Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched [2026-05-05 11:17:45] [SUCCESS] Resource tracking method set to 'annotation' [2026-05-05 11:17:45] [SUBSTEP] Restarting GitOps server deployment deployment.apps/openshift-gitops-server restarted [2026-05-05 11:17:45] [SUCCESS] GitOps server restart initiated [2026-05-05 11:17:45] [INFO] Waiting for rollout to complete... Waiting for deployment "openshift-gitops-server" rollout to finish: 0 out of 1 new replicas have been updated... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... deployment "openshift-gitops-server" successfully rolled out [2026-05-05 11:18:16] [SUCCESS] GitOps server rollout complete ============================================================================= [2026-05-05 11:18:16] [STEP] ArgoCD Access Information ============================================================================= [2026-05-05 11:18:16] [INFO] ArgoCD URL: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com [2026-05-05 11:18:16] [INFO] Authentication: Use 'Login with OpenShift' button (OpenShift credentials) [2026-05-05 11:18:16] [SUBSTEP] Verifying ArgoCD route is accessible [2026-05-05 11:18:36] [WAITING] Waiting for route to respond (5s/120s) [2026-05-05 11:18:41] [SUCCESS] ArgoCD is accessible at https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com [ARGOCD_DEPLOY_JSON] {"status":"success","url":"https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com","namespace":"openshift-gitops","auth_method":"openshift"} ============================================================================= [2026-05-05 11:18:41] [STEP] OpenShift GitOps Deployment Complete ============================================================================= ============================================================================= [2026-05-05 11:18:41] [STEP] Phase 2: Bootstrapping Host Cluster ============================================================================= [2026-05-05 11:18:41] [INFO] Bootstrapping host cluster components [2026-05-05 11:18:41] [INFO] No preview.env file found - using environment variables only [2026-05-05 11:18:41] [SUBSTEP] Configuring Quality Dashboard secrets Setting secrets for Quality Dashboard namespace/quality-dashboard created secret/quality-dashboard-secrets created [2026-05-05 11:18:45] [SUCCESS] Quality Dashboard secrets configured [2026-05-05 11:18:45] [SUBSTEP] Configuring CI Helper App secret Creating secret for CI Helper App namespace/ci-helper-app created secret/ci-helper-app-secrets created [2026-05-05 11:18:48] [SUCCESS] CI Helper App secret configured [2026-05-05 11:18:48] [SUCCESS] Host cluster bootstrap complete ============================================================================= [2026-05-05 11:18:48] [STEP] Phase 3: Bootstrapping Member Cluster ============================================================================= [2026-05-05 11:18:48] [INFO] Bootstrapping member cluster components [2026-05-05 11:18:48] [INFO] No preview.env file found - using environment variables only [2026-05-05 11:18:48] [SUBSTEP] Configuring Pipeline Service secrets Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation namespace/product-kubearchive-logging created Creating DB secret secret/tekton-results-database created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config secret/minio-storage-configuration created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config MinIO config already exists, skipping creation Creating Postgres TLS certs secret/postgresql-tls created configmap/rds-root-crt created [2026-05-05 11:18:51] [SUCCESS] Pipeline Service secrets configured [2026-05-05 11:18:51] [SUBSTEP] Configuring GitHub secrets [2026-05-05 11:18:51] [INFO] GitHub token provided - creating secrets namespace/application-service created Creating a has secret from legacy token secret/has-github-token created [2026-05-05 11:18:52] [SUCCESS] GitHub secrets configured [2026-05-05 11:18:52] [SUBSTEP] Configuring Image Controller secrets [2026-05-05 11:18:52] [INFO] Quay organization: redhat-appstudio-qe Creating a secret with a token for Image Controller namespace/image-controller created secret/quaytoken created [2026-05-05 11:18:52] [SUCCESS] Image Controller secrets configured [2026-05-05 11:18:52] [SUCCESS] Member cluster bootstrap complete ============================================================================= [2026-05-05 11:18:52] [STEP] Phase 4: Bootstrapping Common Components ============================================================================= [2026-05-05 11:18:52] [INFO] Bootstrapping common cluster components [2026-05-05 11:18:52] [INFO] No preview.env file found at /tmp/tmp.QooiWRKa1o/tmp/infra-deployments/hack/../hack/preview.env - using environment variables only [2026-05-05 11:18:52] [SUBSTEP] Configuring Docker Hub pull secret Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.9lJthMG2PG secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.9lJthMG2PG secret/docker-io-pull created [2026-05-05 11:18:54] [SUCCESS] Docker Hub pull secret configured [2026-05-05 11:18:54] [SUBSTEP] Configuring DORA metrics exporter secrets Setting secrets for Dora metrics exporter namespace/dora-metrics created secret/exporters-secret created [2026-05-05 11:18:54] [SUCCESS] DORA metrics exporter secrets configured [2026-05-05 11:18:54] [SUCCESS] Common cluster bootstrap complete ============================================================================= [2026-05-05 11:18:54] [STEP] Phase 5: Mode-Specific Deployment (preview) ============================================================================= [2026-05-05 11:18:54] [INFO] Deploying preview configuration ============================================================================= [2026-05-05 11:18:54] [STEP] Starting Konflux Preview Environment Setup ============================================================================= [2026-05-05 11:18:54] [INFO] Script: /tmp/tmp.QooiWRKa1o/tmp/infra-deployments/hack/../hack/preview.sh [2026-05-05 11:18:54] [INFO] Options: OBO=false, GRAFANA=false, EAAS=false [2026-05-05 11:18:54] [INFO] Start time: 2026-05-05 11:18:54 UTC ============================================================================= [2026-05-05 11:18:54] [STEP] Cluster Context Information ============================================================================= [2026-05-05 11:18:55] [INFO] OpenShift Version: 4.18.9 [2026-05-05 11:18:55] [INFO] API Server: https://api.kx-e93a914379.l72d.p3.openshiftapps.com:443 [2026-05-05 11:18:55] [INFO] Cluster ID: bc82e2f4-8286-4831-90c1-9373d4d741e9 [2026-05-05 11:18:55] [INFO] Cluster Domain: apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com [2026-05-05 11:18:55] [INFO] Total Nodes: 3 [2026-05-05 11:18:55] [INFO] - Master nodes: 0 [2026-05-05 11:18:55] [INFO] - Worker nodes: 3 [2026-05-05 11:18:55] [SUCCESS] Cluster operators: All healthy [CLUSTER_CONTEXT_JSON] {"ocp_version":"4.18.9","api_server":"https://api.kx-e93a914379.l72d.p3.openshiftapps.com:443","cluster_id":"bc82e2f4-8286-4831-90c1-9373d4d741e9","cluster_domain":"apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com","total_nodes":3,"master_nodes":0,"worker_nodes":3,"degraded_operators":0} Switched to a new branch 'preview-main-zwwg' [2026-05-05 11:18:55] [SUCCESS] Git environment initialized [2026-05-05 11:18:55] [INFO] - Repository URL: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-05-05 11:18:55] [INFO] - Source branch: main [2026-05-05 11:18:55] [INFO] - Preview branch: preview-main-zwwg [2026-05-05 11:18:55] [INFO] - GitHub org: redhat-appstudio-qe ============================================================================= [2026-05-05 11:18:55] [STEP] Patching ArgoCD application manifests to use fork repository ============================================================================= [2026-05-05 11:18:55] [INFO] Setting repoURL to: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-05-05 11:18:55] [INFO] Setting targetRevision to: preview-main-zwwg [2026-05-05 11:18:55] [SUBSTEP] Patched: application-patch.yaml [2026-05-05 11:18:55] [SUBSTEP] Patched: application-set-patch.yaml [2026-05-05 11:18:55] [SUBSTEP] Patched: application-set-multisrc-src-1-patch.yaml [2026-05-05 11:18:55] [SUCCESS] All ArgoCD patch files updated ============================================================================= [2026-05-05 11:18:55] [STEP] Labeling cluster nodes for Konflux workloads ============================================================================= [2026-05-05 11:18:55] [INFO] Reference: https://github.com/redhat-appstudio/infra-deployments/pull/4415 [2026-05-05 11:18:56] [INFO] Found 3 nodes to label with 'konflux-ci.dev/workload=konflux-tenants' [2026-05-05 11:18:56] [SUBSTEP] Labeling node/ip-10-0-142-221.ec2.internal node/ip-10-0-142-221.ec2.internal labeled [2026-05-05 11:18:56] [SUCCESS] Successfully labeled node/ip-10-0-142-221.ec2.internal [2026-05-05 11:18:56] [SUBSTEP] Labeling node/ip-10-0-150-84.ec2.internal node/ip-10-0-150-84.ec2.internal labeled [2026-05-05 11:18:56] [SUCCESS] Successfully labeled node/ip-10-0-150-84.ec2.internal [2026-05-05 11:18:56] [SUBSTEP] Labeling node/ip-10-0-168-100.ec2.internal node/ip-10-0-168-100.ec2.internal labeled [2026-05-05 11:18:56] [SUCCESS] Successfully labeled node/ip-10-0-168-100.ec2.internal [2026-05-05 11:18:56] [SUBSTEP] Verifying labels on all nodes... [2026-05-05 11:18:56] [SUCCESS] All 3 nodes labeled and verified successfully ============================================================================= [2026-05-05 11:18:56] [STEP] Checking OCP version for Kueue compatibility ============================================================================= [2026-05-05 11:18:56] [INFO] Detected OpenShift Container Platform version: 4.18.9 (minor: 18) [2026-05-05 11:18:56] [SUCCESS] OCP version 4.18.9 meets Kueue requirements - Kueue will be deployed ============================================================================= [2026-05-05 11:18:56] [STEP] Configuring GitHub organization ============================================================================= [2026-05-05 11:18:56] [INFO] Setting GitHub org to: redhat-appstudio-qe [2026-05-05 11:18:56] [INFO] Configuring GitHub organization for Application Service (HAS) [2026-05-05 11:18:56] [INFO] - Target org: redhat-appstudio-qe [2026-05-05 11:18:56] [INFO] - Config file: /tmp/tmp.QooiWRKa1o/tmp/infra-deployments/hack/../components/has/base/kustomization.yaml [2026-05-05 11:18:56] [SUCCESS] GitHub organization set to 'redhat-appstudio-qe' [2026-05-05 11:18:56] [SUCCESS] Verified: Configuration updated correctly [2026-05-05 11:18:56] [SUCCESS] GitHub organization configured ============================================================================= [2026-05-05 11:18:56] [STEP] Configuring Rekor server hostname ============================================================================= [2026-05-05 11:18:56] [INFO] Cluster domain: apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com [2026-05-05 11:18:56] [INFO] Rekor server hostname: rekor.apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com [2026-05-05 11:18:56] [SUCCESS] Rekor server hostname configured ============================================================================= [2026-05-05 11:18:56] [STEP] Applying service image overrides from environment variables ============================================================================= [2026-05-05 11:18:56] [INFO] No service image overrides configured - using default images ============================================================================= [2026-05-05 11:18:56] [STEP] Committing and pushing preview changes ============================================================================= [preview-main-zwwg 6a6bb0593] Preview mode, do not merge into main 8 files changed, 15 insertions(+), 19 deletions(-) remote: remote: Create a pull request for 'preview-main-zwwg' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-zwwg remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-zwwg -> preview-main-zwwg branch 'preview-main-zwwg' set up to track 'qe/preview-main-zwwg'. [2026-05-05 11:18:57] [SUCCESS] Preview changes committed and pushed to qe/preview-main-zwwg ============================================================================= [2026-05-05 11:18:57] [STEP] Deploying ArgoCD applications ============================================================================= [2026-05-05 11:18:57] [SUBSTEP] Applying root Application from: /tmp/tmp.QooiWRKa1o/tmp/infra-deployments/hack/../argo-cd-apps/app-of-app-sets/development application.argoproj.io/all-application-sets created [2026-05-05 11:18:58] [SUCCESS] Root Application 'all-application-sets' created [2026-05-05 11:18:58] [SUBSTEP] Waiting for 'all-application-sets' to become Healthy and Synced [2026-05-05 11:18:58] [WAITING] Root application status: ' ' (target: 'Healthy Synced') - 5s elapsed [2026-05-05 11:19:03] [WAITING] Root application status: ' ' (target: 'Healthy Synced') - 10s elapsed [2026-05-05 11:19:08] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 15s elapsed [2026-05-05 11:19:14] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 20s elapsed [2026-05-05 11:19:19] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 25s elapsed [2026-05-05 11:19:24] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 30s elapsed [2026-05-05 11:19:29] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 35s elapsed [2026-05-05 11:19:34] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 40s elapsed [2026-05-05 11:19:40] [SUCCESS] Root application 'all-application-sets' is Healthy and Synced [2026-05-05 11:19:40] [SUBSTEP] Triggering hard refresh on all ArgoCD applications [2026-05-05 11:19:40] [INFO] Found 43 applications to refresh application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/monitoring-cardinality-in-cluster-local patched application.argoproj.io/has-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/disaster-recovery-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/backup-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/monitoring-workload-custom-kube-state-metrics-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/monitoring-registry-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/konflux-info-in-cluster-local patched application.argoproj.io/smee-client-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/dora-metrics-in-cluster-local patched application.argoproj.io/image-rbac-proxy-in-cluster-local patched [2026-05-05 11:19:47] [SUCCESS] Hard refresh triggered on all 43 applications [2026-05-05 11:19:47] [SUBSTEP] Waiting for refresh operations to complete [2026-05-05 11:19:47] [PROGRESS] Refresh: 0/43 complete | 43 still refreshing (5s elapsed) [2026-05-05 11:19:53] [PROGRESS] Refresh: 0/43 complete | 43 still refreshing (10s elapsed) [2026-05-05 11:19:58] [PROGRESS] Refresh: 10/43 complete | 33 still refreshing (15s elapsed) [2026-05-05 11:20:03] [PROGRESS] Refresh: 14/43 complete | 29 still refreshing (20s elapsed) [2026-05-05 11:20:09] [PROGRESS] Refresh: 29/43 complete | 14 still refreshing (25s elapsed) [2026-05-05 11:20:14] [PROGRESS] Refresh: 34/43 complete | 9 still refreshing (30s elapsed) [2026-05-05 11:20:20] [PROGRESS] Refresh: 38/43 complete | 5 still refreshing (35s elapsed) [2026-05-05 11:20:25] [PROGRESS] Refresh: 40/43 complete | 3 still refreshing (40s elapsed) [2026-05-05 11:20:30] [PROGRESS] Refresh: 40/43 complete | 3 still refreshing (45s elapsed) [2026-05-05 11:20:36] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (50s elapsed) [2026-05-05 11:20:41] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (55s elapsed) [2026-05-05 11:20:46] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (60s elapsed) [2026-05-05 11:20:52] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (65s elapsed) [2026-05-05 11:20:57] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (70s elapsed) [2026-05-05 11:21:02] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (75s elapsed) [2026-05-05 11:21:08] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (80s elapsed) [2026-05-05 11:21:13] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (85s elapsed) [2026-05-05 11:21:18] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (90s elapsed) [2026-05-05 11:21:24] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (95s elapsed) [2026-05-05 11:21:29] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (100s elapsed) [2026-05-05 11:21:34] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (105s elapsed) [2026-05-05 11:21:40] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (110s elapsed) [2026-05-05 11:21:45] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (115s elapsed) [2026-05-05 11:21:50] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (120s elapsed) [2026-05-05 11:21:56] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (125s elapsed) [2026-05-05 11:22:01] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (130s elapsed) [2026-05-05 11:22:07] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (135s elapsed) [2026-05-05 11:22:12] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (140s elapsed) [2026-05-05 11:22:17] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (145s elapsed) [2026-05-05 11:22:22] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (150s elapsed) [2026-05-05 11:22:28] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (155s elapsed) [2026-05-05 11:22:33] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (160s elapsed) [2026-05-05 11:22:39] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (165s elapsed) [2026-05-05 11:22:44] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (170s elapsed) [2026-05-05 11:22:49] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (175s elapsed) [2026-05-05 11:22:55] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (180s elapsed) [2026-05-05 11:23:00] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (185s elapsed) [2026-05-05 11:23:05] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (190s elapsed) [2026-05-05 11:23:11] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (195s elapsed) [2026-05-05 11:23:16] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (200s elapsed) [2026-05-05 11:23:21] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (205s elapsed) [2026-05-05 11:23:27] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (210s elapsed) [2026-05-05 11:23:32] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (215s elapsed) [2026-05-05 11:23:37] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (220s elapsed) [2026-05-05 11:23:43] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (225s elapsed) [2026-05-05 11:23:48] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (230s elapsed) [2026-05-05 11:23:53] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (235s elapsed) [2026-05-05 11:23:59] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (240s elapsed) [2026-05-05 11:24:04] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (245s elapsed) [2026-05-05 11:24:09] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (250s elapsed) [2026-05-05 11:24:15] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (255s elapsed) [2026-05-05 11:24:20] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (260s elapsed) [2026-05-05 11:24:25] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (265s elapsed) [2026-05-05 11:24:31] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (270s elapsed) [2026-05-05 11:24:36] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (275s elapsed) [2026-05-05 11:24:41] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (280s elapsed) [2026-05-05 11:24:47] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (285s elapsed) [2026-05-05 11:24:52] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (290s elapsed) [2026-05-05 11:24:58] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (295s elapsed) [2026-05-05 11:25:03] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (300s elapsed) [2026-05-05 11:25:08] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (305s elapsed) [2026-05-05 11:25:14] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (310s elapsed) [2026-05-05 11:25:19] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (315s elapsed) [2026-05-05 11:25:24] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (320s elapsed) [2026-05-05 11:25:30] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (325s elapsed) [2026-05-05 11:25:35] [SUCCESS] All 43 applications refreshed ============================================================================= [2026-05-05 11:25:35] [STEP] Waiting for all ArgoCD applications to sync and become healthy ============================================================================= [2026-05-05 11:25:35] [INFO] Timeout: 2700 seconds (45 minutes) [2026-05-05 11:25:35] [PROGRESS] Applications: 33/44 ready | 11 pending (0m 0s elapsed) [2026-05-05 11:25:35] [INFO] Pending: enterprise-contract-in-cluster-local,integration-in-cluster-local,konflux-kite-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,release-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-05-05 11:25:35] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:25:45] [PROGRESS] Applications: 35/44 ready | 9 pending (0m 10s elapsed) [2026-05-05 11:25:45] [INFO] Pending: enterprise-contract-in-cluster-local,integration-in-cluster-local,konflux-kite-in-cluster-local,kubearchive-in-cluster-local,kyverno-in-cluster-local,pipeline-service-in-cluster-local,release-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-05-05 11:25:45] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:25:55] [PROGRESS] Applications: 36/44 ready | 8 pending (0m 20s elapsed) [2026-05-05 11:25:55] [INFO] Pending: enterprise-contract-in-cluster-local,integration-in-cluster-local,kubearchive-in-cluster-local,kyverno-in-cluster-local,pipeline-service-in-cluster-local,release-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-05-05 11:25:55] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:26:06] [PROGRESS] Applications: 35/44 ready | 9 pending (0m 31s elapsed) [2026-05-05 11:26:06] [INFO] Pending: enterprise-contract-in-cluster-local,integration-in-cluster-local,konflux-kite-in-cluster-local,kubearchive-in-cluster-local,kyverno-in-cluster-local,pipeline-service-in-cluster-local,release-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-05-05 11:26:06] [WARN] Found applications in Unknown state (not Progressing), investigating... [2026-05-05 11:26:06] [ERROR] Application 'vector-kubearchive-log-collector-in-cluster-local' is in Unknown state without 'context deadline exceeded' Switched to branch 'main' Your branch is up to date with 'upstream/main'. I0505 11:26:06.676363 21451 common.go:278] got an error: exit status 141 - will retry in 10s [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 106 [running]: > runtime/debug.Stack() > /usr/lib/golang/src/runtime/debug/stack.go:26 +0x5e > sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot() > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/log/log.go:60 +0xcd > sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0xc00098fec0, {0x37b3bb6, 0x14}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/log/deleg.go:147 +0x3e > github.com/go-logr/logr.Logger.WithName({{0x4038300, 0xc00098fec0}, 0x0}, {0x37b3bb6?, 0x0?}) > /opt/app-root/src/go/pkg/mod/github.com/go-logr/logr@v1.4.3/logr.go:345 +0x36 > sigs.k8s.io/controller-runtime/pkg/client.newClient(0x1?, {0x0, 0xc0013850a0, {0x0, 0x0}, 0x0, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/client/client.go:118 +0xdb > sigs.k8s.io/controller-runtime/pkg/client.New(0xc000b8c008?, {0x0, 0xc0013850a0, {0x0, 0x0}, 0x0, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/client/client.go:98 +0x4d > github.com/konflux-ci/e2e-tests/pkg/clients/kubernetes.NewAdminKubernetesClient() > /tmp/tmp.QooiWRKa1o/pkg/clients/kubernetes/client.go:159 +0x8f > github.com/konflux-ci/e2e-tests/magefiles/installation.NewAppStudioInstallController() > /tmp/tmp.QooiWRKa1o/magefiles/installation/install.go:105 +0x31 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.InstallKonflux() > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/repos/common.go:262 +0x13 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.retry(0x3b72a10, 0x2, 0x2540be400) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/repos/common.go:281 +0xf9 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.init.func7(0x3ff3740?) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/repos/common.go:355 +0xae > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.ActionFunc.Execute(0xc?, 0x378ae1a?) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/types.go:279 +0x19 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Apply(...) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/types.go:315 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x61a6fc0, 0xc000a6c008) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/types.go:348 +0xb3 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x619eda0?, 0xc0011e5bd8?, 0x2411579?}, 0xc000a6c008) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x61a70e0, 0xc000a6c008) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/types.go:340 +0x2b > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x61a8d60?, 0x2?, 0xc000a5ea80?}, 0xc000a6c008) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).runLoadedCatalog(0x61df9b0, {0xc001719b88?, 0xc00162fe60?, 0x37e6f20?}, 0xc000a6c008) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/types.go:129 +0x11f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).RunRulesOfCategory(0x61df9b0, {0x3784d62, 0x2}, 0xc000a6c008) > /tmp/tmp.QooiWRKa1o/magefiles/rulesengine/types.go:121 +0x1b4 > main.CI.TestE2E({}) > /tmp/tmp.QooiWRKa1o/magefiles/magefile.go:330 +0x18a > main.main.func20({0xc00040ca80?, 0xc0000acc08?}) > /tmp/tmp.QooiWRKa1o/magefiles/mage_output_file.go:888 +0xf > main.main.func12.1() > /tmp/tmp.QooiWRKa1o/magefiles/mage_output_file.go:306 +0x5b > created by main.main.func12 in goroutine 1 > /tmp/tmp.QooiWRKa1o/magefiles/mage_output_file.go:301 +0xbe W0505 11:26:16.682047 21451 install.go:185] folder /tmp/tmp.QooiWRKa1o/tmp/infra-deployments already exists... removing I0505 11:26:16.838885 21451 install.go:226] cloning 'https://github.com/redhat-appstudio/infra-deployments' (ref: 'refs/heads/main', remote: 'upstream') Enumerating objects: 80366, done. Counting objects: 1% (1/62) Counting objects: 3% (2/62) Counting objects: 4% (3/62) Counting objects: 6% (4/62) Counting objects: 8% (5/62) Counting objects: 9% (6/62) Counting objects: 11% (7/62) Counting objects: 12% (8/62) Counting objects: 14% (9/62) Counting objects: 16% (10/62) Counting objects: 17% (11/62) Counting objects: 19% (12/62) Counting objects: 20% (13/62) Counting objects: 22% (14/62) Counting objects: 24% (15/62) Counting objects: 25% (16/62) Counting objects: 27% (17/62) Counting objects: 29% (18/62) Counting objects: 30% (19/62) Counting objects: 32% (20/62) Counting objects: 33% (21/62) Counting objects: 35% (22/62) Counting objects: 37% (23/62) Counting objects: 38% (24/62) Counting objects: 40% (25/62) Counting objects: 41% (26/62) Counting objects: 43% (27/62) Counting objects: 45% (28/62) Counting objects: 46% (29/62) Counting objects: 48% (30/62) Counting objects: 50% (31/62) Counting objects: 51% (32/62) Counting objects: 53% (33/62) Counting objects: 54% (34/62) Counting objects: 56% (35/62) Counting objects: 58% (36/62) Counting objects: 59% (37/62) Counting objects: 61% (38/62) Counting objects: 62% (39/62) Counting objects: 64% (40/62) Counting objects: 66% (41/62) Counting objects: 67% (42/62) Counting objects: 69% (43/62) Counting objects: 70% (44/62) Counting objects: 72% (45/62) Counting objects: 74% (46/62) Counting objects: 75% (47/62) Counting objects: 77% (48/62) Counting objects: 79% (49/62) Counting objects: 80% (50/62) Counting objects: 82% (51/62) Counting objects: 83% (52/62) Counting objects: 85% (53/62) Counting objects: 87% (54/62) Counting objects: 88% (55/62) Counting objects: 90% (56/62) Counting objects: 91% (57/62) Counting objects: 93% (58/62) Counting objects: 95% (59/62) Counting objects: 96% (60/62) Counting objects: 98% (61/62) Counting objects: 100% (62/62) Counting objects: 100% (62/62), done. Compressing objects: 3% (1/33) Compressing objects: 6% (2/33) Compressing objects: 9% (3/33) Compressing objects: 12% (4/33) Compressing objects: 15% (5/33) Compressing objects: 18% (6/33) Compressing objects: 21% (7/33) Compressing objects: 24% (8/33) Compressing objects: 27% (9/33) Compressing objects: 30% (10/33) Compressing objects: 33% (11/33) Compressing objects: 36% (12/33) Compressing objects: 39% (13/33) Compressing objects: 42% (14/33) Compressing objects: 45% (15/33) Compressing objects: 48% (16/33) Compressing objects: 51% (17/33) Compressing objects: 54% (18/33) Compressing objects: 57% (19/33) Compressing objects: 60% (20/33) Compressing objects: 63% (21/33) Compressing objects: 66% (22/33) Compressing objects: 69% (23/33) Compressing objects: 72% (24/33) Compressing objects: 75% (25/33) Compressing objects: 78% (26/33) Compressing objects: 81% (27/33) Compressing objects: 84% (28/33) Compressing objects: 87% (29/33) Compressing objects: 90% (30/33) Compressing objects: 93% (31/33) Compressing objects: 96% (32/33) Compressing objects: 100% (33/33) Compressing objects: 100% (33/33), done. Total 80366 (delta 50), reused 29 (delta 29), pack-reused 80304 (from 2) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. ============================================================================= [2026-05-05 11:26:21] [STEP] Starting Konflux Cluster Bootstrap ============================================================================= [2026-05-05 11:26:21] [INFO] Mode: preview [2026-05-05 11:26:21] [INFO] Options: OBO=disabled, EAAS=disabled [2026-05-05 11:26:21] [INFO] Start time: 2026-05-05 11:26:21 UTC ============================================================================= [2026-05-05 11:26:21] [STEP] Phase 1: Deploying ArgoCD ============================================================================= ============================================================================= [2026-05-05 11:26:21] [STEP] Deploying OpenShift GitOps (ArgoCD) ============================================================================= [2026-05-05 11:26:21] [SUBSTEP] Verifying cluster-admin permissions [2026-05-05 11:26:21] [SUCCESS] User 'cluster-admin' has cluster-admin permissions [2026-05-05 11:26:21] [SUBSTEP] Installing OpenShift GitOps operator subscription clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller unchanged clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server unchanged clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller unchanged clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server unchanged subscription.operators.coreos.com/openshift-gitops-operator unchanged [2026-05-05 11:26:22] [SUCCESS] GitOps operator subscription applied [2026-05-05 11:26:22] [SUBSTEP] Waiting for default ArgoCD project to be created [2026-05-05 11:26:22] [SUCCESS] Default ArgoCD project is available [2026-05-05 11:26:22] [SUBSTEP] Waiting for OpenShift GitOps route to be created [2026-05-05 11:26:22] [SUCCESS] OpenShift GitOps route is available [2026-05-05 11:26:22] [SUBSTEP] Configuring ArgoCD repo server resources and timeout argocd.argoproj.io/openshift-gitops patched (no change) [2026-05-05 11:26:23] [SUCCESS] Repo server configured: timeout=5m, cpu=100m, memory=100Mi [2026-05-05 11:26:23] [SUBSTEP] Configuring ArgoCD application controller resources argocd.argoproj.io/openshift-gitops patched (no change) [2026-05-05 11:26:23] [SUCCESS] Application controller configured: cpu=4, memory=4Gi [2026-05-05 11:26:23] [SUBSTEP] Switching ArgoCD route to re-encryption TLS argocd.argoproj.io/openshift-gitops patched (no change) [2026-05-05 11:26:23] [SUCCESS] Route TLS termination set to 'reencrypt' [2026-05-05 11:26:23] [SUBSTEP] Restarting ArgoCD server after TLS configuration change pod "openshift-gitops-server-7479c96d59-x2sn8" deleted [2026-05-05 11:26:24] [SUCCESS] ArgoCD server pods deleted for restart [2026-05-05 11:26:24] [SUBSTEP] Granting admin role to authenticated users [2026-05-05 11:26:24] [INFO] Note: This should be updated once proper access policy is in place argocd.argoproj.io/openshift-gitops patched (no change) [2026-05-05 11:26:24] [SUCCESS] RBAC policy set: system:authenticated -> role:admin [2026-05-05 11:26:24] [SUBSTEP] Configuring PVC health check (WaitForFirstConsumer workaround) Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) [2026-05-05 11:26:24] [SUCCESS] PVC health customization applied (Pending/Bound = Healthy) [2026-05-05 11:26:24] [SUBSTEP] Enabling Helm support in Kustomize builds argocd.argoproj.io/openshift-gitops patched (no change) [2026-05-05 11:26:25] [SUCCESS] Kustomize build options set: --enable-helm [2026-05-05 11:26:25] [SUBSTEP] Configuring ArgoCD to ignore aggregated roles in diff argocd.argoproj.io/openshift-gitops patched (no change) [2026-05-05 11:26:25] [SUCCESS] ignoreAggregatedRoles set to true [2026-05-05 11:26:25] [SUBSTEP] Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched (no change) [2026-05-05 11:26:25] [SUCCESS] Resource tracking method set to 'annotation' [2026-05-05 11:26:25] [SUBSTEP] Restarting GitOps server deployment deployment.apps/openshift-gitops-server restarted [2026-05-05 11:26:25] [SUCCESS] GitOps server restart initiated [2026-05-05 11:26:25] [INFO] Waiting for rollout to complete... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... deployment "openshift-gitops-server" successfully rolled out [2026-05-05 11:26:55] [SUCCESS] GitOps server rollout complete ============================================================================= [2026-05-05 11:26:55] [STEP] ArgoCD Access Information ============================================================================= [2026-05-05 11:26:56] [INFO] ArgoCD URL: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com [2026-05-05 11:26:56] [INFO] Authentication: Use 'Login with OpenShift' button (OpenShift credentials) [2026-05-05 11:26:56] [SUBSTEP] Verifying ArgoCD route is accessible [2026-05-05 11:26:56] [SUCCESS] ArgoCD is accessible at https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com [ARGOCD_DEPLOY_JSON] {"status":"success","url":"https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com","namespace":"openshift-gitops","auth_method":"openshift"} ============================================================================= [2026-05-05 11:26:56] [STEP] OpenShift GitOps Deployment Complete ============================================================================= ============================================================================= [2026-05-05 11:26:56] [STEP] Phase 2: Bootstrapping Host Cluster ============================================================================= [2026-05-05 11:26:56] [INFO] Bootstrapping host cluster components [2026-05-05 11:26:56] [INFO] No preview.env file found - using environment variables only [2026-05-05 11:26:56] [SUBSTEP] Configuring Quality Dashboard secrets Setting secrets for Quality Dashboard namespace/quality-dashboard configured [2026-05-05 11:26:57] [SUCCESS] Quality Dashboard secrets configured [2026-05-05 11:26:57] [SUBSTEP] Configuring CI Helper App secret Creating secret for CI Helper App namespace/ci-helper-app configured [2026-05-05 11:26:57] [SUCCESS] CI Helper App secret configured [2026-05-05 11:26:57] [SUCCESS] Host cluster bootstrap complete ============================================================================= [2026-05-05 11:26:57] [STEP] Phase 3: Bootstrapping Member Cluster ============================================================================= [2026-05-05 11:26:57] [INFO] Bootstrapping member cluster components [2026-05-05 11:26:57] [INFO] No preview.env file found - using environment variables only [2026-05-05 11:26:57] [SUBSTEP] Configuring Pipeline Service secrets Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation product-kubearchive-logging namespace already exists, skipping creation Creating DB secret DB secret already exists, skipping creation Creating S3 secret S3 secret already exists, skipping creation Creating S3 secret S3 secret already exists, skipping creation Creating Postgres TLS certs Postgres DB cert secret already exists, skipping creation [2026-05-05 11:26:58] [SUCCESS] Pipeline Service secrets configured [2026-05-05 11:26:58] [SUBSTEP] Configuring GitHub secrets [2026-05-05 11:26:58] [INFO] GitHub token provided - creating secrets namespace/application-service configured Creating a has secret from legacy token secret/has-github-token configured [2026-05-05 11:27:00] [SUCCESS] GitHub secrets configured [2026-05-05 11:27:00] [SUBSTEP] Configuring Image Controller secrets [2026-05-05 11:27:00] [INFO] Quay organization: redhat-appstudio-qe Creating a secret with a token for Image Controller namespace/image-controller configured secret/quaytoken configured [2026-05-05 11:27:01] [SUCCESS] Image Controller secrets configured [2026-05-05 11:27:01] [SUCCESS] Member cluster bootstrap complete ============================================================================= [2026-05-05 11:27:01] [STEP] Phase 4: Bootstrapping Common Components ============================================================================= [2026-05-05 11:27:01] [INFO] Bootstrapping common cluster components [2026-05-05 11:27:01] [INFO] No preview.env file found at /tmp/tmp.QooiWRKa1o/tmp/infra-deployments/hack/../hack/preview.env - using environment variables only [2026-05-05 11:27:01] [SUBSTEP] Configuring Docker Hub pull secret Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.P03AVnrBGy secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.P03AVnrBGy secret/docker-io-pull configured [2026-05-05 11:27:02] [SUCCESS] Docker Hub pull secret configured [2026-05-05 11:27:02] [SUBSTEP] Configuring DORA metrics exporter secrets Setting secrets for Dora metrics exporter namespace/dora-metrics configured [2026-05-05 11:27:03] [SUCCESS] DORA metrics exporter secrets configured [2026-05-05 11:27:03] [SUCCESS] Common cluster bootstrap complete ============================================================================= [2026-05-05 11:27:03] [STEP] Phase 5: Mode-Specific Deployment (preview) ============================================================================= [2026-05-05 11:27:03] [INFO] Deploying preview configuration ============================================================================= [2026-05-05 11:27:03] [STEP] Starting Konflux Preview Environment Setup ============================================================================= [2026-05-05 11:27:03] [INFO] Script: /tmp/tmp.QooiWRKa1o/tmp/infra-deployments/hack/../hack/preview.sh [2026-05-05 11:27:03] [INFO] Options: OBO=false, GRAFANA=false, EAAS=false [2026-05-05 11:27:03] [INFO] Start time: 2026-05-05 11:27:03 UTC ============================================================================= [2026-05-05 11:27:03] [STEP] Cluster Context Information ============================================================================= [2026-05-05 11:27:03] [INFO] OpenShift Version: 4.18.9 [2026-05-05 11:27:03] [INFO] API Server: https://api.kx-e93a914379.l72d.p3.openshiftapps.com:443 [2026-05-05 11:27:03] [INFO] Cluster ID: bc82e2f4-8286-4831-90c1-9373d4d741e9 [2026-05-05 11:27:03] [INFO] Cluster Domain: apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com [2026-05-05 11:27:03] [INFO] Total Nodes: 3 [2026-05-05 11:27:04] [INFO] - Master nodes: 0 [2026-05-05 11:27:04] [INFO] - Worker nodes: 3 [2026-05-05 11:27:04] [SUCCESS] Cluster operators: All healthy [CLUSTER_CONTEXT_JSON] {"ocp_version":"4.18.9","api_server":"https://api.kx-e93a914379.l72d.p3.openshiftapps.com:443","cluster_id":"bc82e2f4-8286-4831-90c1-9373d4d741e9","cluster_domain":"apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com","total_nodes":3,"master_nodes":0,"worker_nodes":3,"degraded_operators":0} Switched to a new branch 'preview-main-zmye' [2026-05-05 11:27:04] [SUCCESS] Git environment initialized [2026-05-05 11:27:04] [INFO] - Repository URL: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-05-05 11:27:04] [INFO] - Source branch: main [2026-05-05 11:27:04] [INFO] - Preview branch: preview-main-zmye [2026-05-05 11:27:04] [INFO] - GitHub org: redhat-appstudio-qe ============================================================================= [2026-05-05 11:27:04] [STEP] Patching ArgoCD application manifests to use fork repository ============================================================================= [2026-05-05 11:27:04] [INFO] Setting repoURL to: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-05-05 11:27:04] [INFO] Setting targetRevision to: preview-main-zmye [2026-05-05 11:27:04] [SUBSTEP] Patched: application-patch.yaml [2026-05-05 11:27:04] [SUBSTEP] Patched: application-set-patch.yaml [2026-05-05 11:27:04] [SUBSTEP] Patched: application-set-multisrc-src-1-patch.yaml [2026-05-05 11:27:04] [SUCCESS] All ArgoCD patch files updated ============================================================================= [2026-05-05 11:27:04] [STEP] Labeling cluster nodes for Konflux workloads ============================================================================= [2026-05-05 11:27:04] [INFO] Reference: https://github.com/redhat-appstudio/infra-deployments/pull/4415 [2026-05-05 11:27:04] [INFO] Found 3 nodes to label with 'konflux-ci.dev/workload=konflux-tenants' [2026-05-05 11:27:04] [SUBSTEP] Labeling node/ip-10-0-142-221.ec2.internal node/ip-10-0-142-221.ec2.internal not labeled [2026-05-05 11:27:04] [SUCCESS] Successfully labeled node/ip-10-0-142-221.ec2.internal [2026-05-05 11:27:04] [SUBSTEP] Labeling node/ip-10-0-150-84.ec2.internal node/ip-10-0-150-84.ec2.internal not labeled [2026-05-05 11:27:05] [SUCCESS] Successfully labeled node/ip-10-0-150-84.ec2.internal [2026-05-05 11:27:05] [SUBSTEP] Labeling node/ip-10-0-168-100.ec2.internal node/ip-10-0-168-100.ec2.internal not labeled [2026-05-05 11:27:05] [SUCCESS] Successfully labeled node/ip-10-0-168-100.ec2.internal [2026-05-05 11:27:05] [SUBSTEP] Verifying labels on all nodes... [2026-05-05 11:27:05] [SUCCESS] All 3 nodes labeled and verified successfully ============================================================================= [2026-05-05 11:27:05] [STEP] Checking OCP version for Kueue compatibility ============================================================================= [2026-05-05 11:27:05] [INFO] Detected OpenShift Container Platform version: 4.18.9 (minor: 18) [2026-05-05 11:27:05] [SUCCESS] OCP version 4.18.9 meets Kueue requirements - Kueue will be deployed ============================================================================= [2026-05-05 11:27:05] [STEP] Configuring GitHub organization ============================================================================= [2026-05-05 11:27:05] [INFO] Setting GitHub org to: redhat-appstudio-qe [2026-05-05 11:27:05] [INFO] Configuring GitHub organization for Application Service (HAS) [2026-05-05 11:27:05] [INFO] - Target org: redhat-appstudio-qe [2026-05-05 11:27:05] [INFO] - Config file: /tmp/tmp.QooiWRKa1o/tmp/infra-deployments/hack/../components/has/base/kustomization.yaml [2026-05-05 11:27:05] [SUCCESS] GitHub organization set to 'redhat-appstudio-qe' [2026-05-05 11:27:05] [SUCCESS] Verified: Configuration updated correctly [2026-05-05 11:27:05] [SUCCESS] GitHub organization configured ============================================================================= [2026-05-05 11:27:05] [STEP] Configuring Rekor server hostname ============================================================================= [2026-05-05 11:27:05] [INFO] Cluster domain: apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com [2026-05-05 11:27:05] [INFO] Rekor server hostname: rekor.apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com [2026-05-05 11:27:05] [SUCCESS] Rekor server hostname configured ============================================================================= [2026-05-05 11:27:05] [STEP] Applying service image overrides from environment variables ============================================================================= [2026-05-05 11:27:05] [INFO] No service image overrides configured - using default images ============================================================================= [2026-05-05 11:27:05] [STEP] Committing and pushing preview changes ============================================================================= [preview-main-zmye 50c6b7a64] Preview mode, do not merge into main 8 files changed, 15 insertions(+), 19 deletions(-) remote: remote: Create a pull request for 'preview-main-zmye' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-zmye remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-zmye -> preview-main-zmye branch 'preview-main-zmye' set up to track 'qe/preview-main-zmye'. [2026-05-05 11:27:06] [SUCCESS] Preview changes committed and pushed to qe/preview-main-zmye ============================================================================= [2026-05-05 11:27:06] [STEP] Deploying ArgoCD applications ============================================================================= [2026-05-05 11:27:06] [SUBSTEP] Applying root Application from: /tmp/tmp.QooiWRKa1o/tmp/infra-deployments/hack/../argo-cd-apps/app-of-app-sets/development application.argoproj.io/all-application-sets configured [2026-05-05 11:27:07] [SUCCESS] Root Application 'all-application-sets' created [2026-05-05 11:27:07] [SUBSTEP] Waiting for 'all-application-sets' to become Healthy and Synced [2026-05-05 11:27:07] [SUCCESS] Root application 'all-application-sets' is Healthy and Synced [2026-05-05 11:27:07] [SUBSTEP] Triggering hard refresh on all ArgoCD applications [2026-05-05 11:27:07] [INFO] Found 44 applications to refresh application.argoproj.io/dora-metrics-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/image-rbac-proxy-in-cluster-local patched application.argoproj.io/smee-client-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched application.argoproj.io/postgres patched application.argoproj.io/has-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/monitoring-registry-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/konflux-info-in-cluster-local patched application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/monitoring-workload-custom-kube-state-metrics-in-cluster-local patched application.argoproj.io/disaster-recovery-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/monitoring-cardinality-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/backup-in-cluster-local patched [2026-05-05 11:27:17] [SUCCESS] Hard refresh triggered on all 44 applications [2026-05-05 11:27:17] [SUBSTEP] Waiting for refresh operations to complete [2026-05-05 11:27:17] [PROGRESS] Refresh: 4/44 complete | 40 still refreshing (5s elapsed) [2026-05-05 11:27:22] [PROGRESS] Refresh: 11/44 complete | 33 still refreshing (10s elapsed) [2026-05-05 11:27:28] [PROGRESS] Refresh: 22/44 complete | 22 still refreshing (15s elapsed) [2026-05-05 11:27:33] [PROGRESS] Refresh: 37/44 complete | 7 still refreshing (20s elapsed) [2026-05-05 11:27:38] [PROGRESS] Refresh: 41/44 complete | 3 still refreshing (25s elapsed) [2026-05-05 11:27:44] [PROGRESS] Refresh: 41/44 complete | 3 still refreshing (30s elapsed) [2026-05-05 11:27:49] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (35s elapsed) [2026-05-05 11:27:54] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (40s elapsed) [2026-05-05 11:28:00] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (45s elapsed) [2026-05-05 11:28:05] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (50s elapsed) [2026-05-05 11:28:10] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (55s elapsed) [2026-05-05 11:28:16] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (60s elapsed) [2026-05-05 11:28:21] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (65s elapsed) [2026-05-05 11:28:26] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (70s elapsed) [2026-05-05 11:28:32] [SUCCESS] All 44 applications refreshed ============================================================================= [2026-05-05 11:28:32] [STEP] Waiting for all ArgoCD applications to sync and become healthy ============================================================================= [2026-05-05 11:28:32] [INFO] Timeout: 2700 seconds (45 minutes) [2026-05-05 11:28:32] [PROGRESS] Applications: 42/44 ready | 2 pending (0m 0s elapsed) [2026-05-05 11:28:32] [INFO] Pending: konflux-kite-in-cluster-local,pipeline-service-in-cluster-local [2026-05-05 11:28:32] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:28:42] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 10s elapsed) [2026-05-05 11:28:42] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:28:42] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:28:52] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 20s elapsed) [2026-05-05 11:28:52] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:28:52] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:29:02] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 30s elapsed) [2026-05-05 11:29:02] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:29:02] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:29:12] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 40s elapsed) [2026-05-05 11:29:12] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:29:12] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:29:23] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 50s elapsed) [2026-05-05 11:29:23] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:29:23] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:29:33] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 1s elapsed) [2026-05-05 11:29:33] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:29:33] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:29:43] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 11s elapsed) [2026-05-05 11:29:43] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:29:43] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:29:53] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 21s elapsed) [2026-05-05 11:29:53] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:29:53] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:30:03] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 31s elapsed) [2026-05-05 11:30:03] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:30:03] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:30:14] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 41s elapsed) [2026-05-05 11:30:14] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:30:14] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:30:24] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 52s elapsed) [2026-05-05 11:30:24] [INFO] Pending: konflux-kite-in-cluster-local [2026-05-05 11:30:24] [WAITING] Waiting 10 seconds before next sync check... [2026-05-05 11:30:34] [PROGRESS] Applications: 44/44 ready | 0 pending (2m 2s elapsed) [2026-05-05 11:30:34] [SUCCESS] All 44 ArgoCD applications are Synced and Healthy in 2m 2s ============================================================================= [2026-05-05 11:30:34] [STEP] Waiting for Tekton components to be ready ============================================================================= [2026-05-05 11:30:34] [INFO] Reference: https://tekton.dev/docs/operator/tektonconfig/#tekton-config [2026-05-05 11:30:34] [INFO] Timeout: 900 seconds (15 minutes) [2026-05-05 11:30:34] [PROGRESS] Tekton readiness check iteration 1: status=True (0m 0s elapsed) [2026-05-05 11:30:34] [SUCCESS] All Tekton components are installed and ready in 0m 0s ============================================================================= [2026-05-05 11:30:34] [STEP] Waiting for Tekton CRDs to be available ============================================================================= [2026-05-05 11:30:34] [PROGRESS] Tekton CRD check attempt 1/5 [2026-05-05 11:30:34] [SUCCESS] All required Tekton CRDs are available: pipelines tasks pipelineruns taskruns ============================================================================= [2026-05-05 11:30:34] [STEP] Configuring Pipelines as Code integration ============================================================================= [2026-05-05 11:30:34] [INFO] ============================================================================= [2026-05-05 11:30:34] [INFO] Pipelines as Code (PAC) Integration Setup [2026-05-05 11:30:34] [INFO] ============================================================================= [2026-05-05 11:30:34] [INFO] PAC Namespace: openshift-pipelines [2026-05-05 11:30:34] [INFO] PAC Secret Name: pipelines-as-code-secret [2026-05-05 11:30:34] [INFO] Integration Namespace: integration-service [2026-05-05 11:30:34] [INFO] Authentication method: GitHub App [2026-05-05 11:30:34] [INFO] - GitHub App ID: 310332 [2026-05-05 11:30:34] [INFO] Using existing QE sprayproxy configuration (webhook secret provided) [2026-05-05 11:30:34] [SUCCESS] GitHub App credentials configured [2026-05-05 11:30:34] [INFO] GitHub token provided via MY_GITHUB_TOKEN (fallback) [2026-05-05 11:30:34] [DEBUG] No GitLab token provided (PAC_GITLAB_TOKEN not set) [2026-05-05 11:30:34] [INFO] Creating required namespaces [2026-05-05 11:30:34] [SUBSTEP] Ensuring namespace 'openshift-pipelines' exists [2026-05-05 11:30:34] [DEBUG] Namespace 'openshift-pipelines' already exists [2026-05-05 11:30:34] [SUBSTEP] Ensuring namespace 'build-service' exists [2026-05-05 11:30:35] [DEBUG] Namespace 'build-service' already exists [2026-05-05 11:30:35] [SUBSTEP] Ensuring namespace 'integration-service' exists [2026-05-05 11:30:35] [DEBUG] Namespace 'integration-service' already exists [2026-05-05 11:30:35] [INFO] Configuring PAC secrets across namespaces [2026-05-05 11:30:35] [SUBSTEP] Creating PAC secret in namespace 'openshift-pipelines' secret/pipelines-as-code-secret created [2026-05-05 11:30:35] [SUCCESS] PAC secret configured in 'openshift-pipelines' [2026-05-05 11:30:35] [SUBSTEP] Creating PAC secret in namespace 'build-service' secret/pipelines-as-code-secret created [2026-05-05 11:30:36] [SUCCESS] PAC secret configured in 'build-service' [2026-05-05 11:30:36] [SUBSTEP] Creating PAC secret in namespace 'integration-service' secret/pipelines-as-code-secret created [2026-05-05 11:30:36] [SUCCESS] PAC secret configured in 'integration-service' [2026-05-05 11:30:36] [SUBSTEP] Creating PAC secret in namespace 'mintmaker' secret/pipelines-as-code-secret created [2026-05-05 11:30:37] [SUCCESS] PAC secret configured in 'mintmaker' [2026-05-05 11:30:37] [INFO] ============================================================================= [2026-05-05 11:30:37] [SUCCESS] PAC Integration Setup Complete [2026-05-05 11:30:37] [INFO] ============================================================================= [2026-05-05 11:30:37] [INFO] Configured namespaces: [2026-05-05 11:30:37] [INFO] - openshift-pipelines (PAC controller) [2026-05-05 11:30:37] [INFO] - build-service (Build Service) [2026-05-05 11:30:37] [INFO] - integration-service (Integration Service) [2026-05-05 11:30:37] [INFO] - mintmaker (Mintmaker) [PAC_SETUP_JSON] {"status":"success","namespaces":["openshift-pipelines","build-service","integration-service","mintmaker"],"github_app_configured":true,"github_token_configured":true,"gitlab_token_configured":false} [2026-05-05 11:30:37] [SUCCESS] Pipelines as Code configured ============================================================================= [2026-05-05 11:30:37] [STEP] Preview Environment Setup Complete ============================================================================= [2026-05-05 11:30:37] [SUCCESS] Konflux preview environment is ready! [2026-05-05 11:30:37] [INFO] - Fork: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-05-05 11:30:37] [INFO] - Branch: preview-main-zmye [2026-05-05 11:30:37] [INFO] - GitHub Org: redhat-appstudio-qe [2026-05-05 11:30:37] [INFO] - OpenShift Version: 4.18.9 [2026-05-05 11:30:37] [INFO] - End time: 2026-05-05 11:30:37 UTC ============================================================================= [2026-05-05 11:30:37] [STEP] Execution Summary ============================================================================= [2026-05-05 11:30:37] [SUCCESS] Status: SUCCESS [2026-05-05 11:30:37] [INFO] Total Execution Time: 3m 34s (214 seconds) [2026-05-05 11:30:37] [INFO] Applications Deployed: 44 [EXECUTION_SUMMARY_JSON] {"status":"success","total_time_seconds":214,"apps_deployed":44,"ocp_version":"4.18.9","preview_branch":"preview-main-zmye","git_repo":"https://github.com/redhat-appstudio-qe/infra-deployments.git"} Switched to branch 'main' Your branch is up to date with 'upstream/main'. ============================================================================= [2026-05-05 11:30:37] [STEP] Cluster Bootstrap Complete ============================================================================= [2026-05-05 11:30:37] [SUCCESS] Konflux cluster bootstrap finished successfully [2026-05-05 11:30:37] [INFO] - Mode: preview [2026-05-05 11:30:37] [INFO] - Total time: 4m 16s [2026-05-05 11:30:37] [INFO] - End time: 2026-05-05 11:30:37 UTC [BOOTSTRAP_SUMMARY_JSON] {"status":"success","mode":"preview","obo_enabled":false,"eaas_enabled":false,"total_time_seconds":256} I0505 11:30:38.060558 21451 common.go:429] Registered PaC server: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com I0505 11:30:38.132296 21451 common.go:454] The PaC servers registered in Sprayproxy: https://pipelines-as-code-controller-openshift-pipelines.apps.konflux-4-18-us-west-2-zp5gq.konflux-qe.devcluster.openshift.com, https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-e93a914379.l72d.p3.openshiftapps.com I0505 11:30:38.132325 21451 common.go:470] going to create new Tekton bundle remote-build for the purpose of testing multi-platform-controller PR I0505 11:30:38.506346 21451 common.go:511] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.9@sha256:62f09c50d552eac57e17638c67e88b0982352a71975858c8ba262bcff293de06 I0505 11:30:38.508385 21451 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777980638-ufmu -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0505 11:30:39.798950 21451 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777980638-ufmu: quay.io/redhat-appstudio-qe/test-images@sha256:9c32cc42ba6b80cfd6d0aae7ac75e85fa86956c6f305f9746ae599a70a00d2fc I0505 11:30:39.798970 21451 common.go:537] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_ARM64 to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777980638-ufmu I0505 11:30:40.079588 21451 common.go:511] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.9@sha256:62f09c50d552eac57e17638c67e88b0982352a71975858c8ba262bcff293de06 I0505 11:30:40.081406 21451 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777980639-oqmf -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0505 11:30:41.250194 21451 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777980639-oqmf: quay.io/redhat-appstudio-qe/test-images@sha256:de7b79cdf14affb700f5eeec533e6969d749645b41cc44baf9323ecc0939d5b9 I0505 11:30:41.250223 21451 common.go:537] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_S390X to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777980639-oqmf I0505 11:30:41.482920 21451 common.go:511] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.9@sha256:62f09c50d552eac57e17638c67e88b0982352a71975858c8ba262bcff293de06 I0505 11:30:41.484703 21451 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777980641-jxrd -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0505 11:30:43.124310 21451 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777980641-jxrd: quay.io/redhat-appstudio-qe/test-images@sha256:9eed1de859a23d1db0cc98d5307f95c81a61aff2e4e002f62e24605a65b8f1cd I0505 11:30:43.124342 21451 common.go:537] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_PPC64LE to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777980641-jxrd exec: ginkgo "--seed=1777979817" "--timeout=1h30m0s" "--grace-period=30s" "--output-interceptor-mode=none" "--no-color" "--json-report=e2e-report.json" "--junit-report=e2e-report.xml" "--procs=20" "--nodes=20" "--p" "--output-dir=/workspace/artifact-dir" "./cmd" "--" go: downloading github.com/konflux-ci/build-service v0.0.0-20240611083846-2dee6cfe6fe4 go: downloading github.com/minio/minio-go/v7 v7.0.99 go: downloading github.com/IBM/go-sdk-core/v5 v5.15.3 go: downloading github.com/IBM/vpc-go-sdk v0.48.0 go: downloading github.com/aws/aws-sdk-go-v2 v1.41.3 go: downloading github.com/aws/aws-sdk-go-v2/config v1.31.3 go: downloading github.com/aws/aws-sdk-go-v2/service/ec2 v1.143.0 go: downloading github.com/google/go-github/v45 v45.2.0 go: downloading github.com/klauspost/crc32 v1.3.0 go: downloading github.com/tinylib/msgp v1.6.1 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/minio/md5-simd v1.1.2 go: downloading github.com/dustin/go-humanize v1.0.1 go: downloading github.com/minio/crc64nvme v1.1.1 go: downloading github.com/rs/xid v1.6.0 go: downloading github.com/aws/smithy-go v1.24.2 go: downloading github.com/philhofer/fwd v1.2.0 go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.18.7 go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.18.4 go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3 go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.28.2 go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.34.0 go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.38.0 go: downloading github.com/go-playground/validator/v10 v10.17.0 go: downloading github.com/go-openapi/strfmt v0.25.0 go: downloading github.com/oklog/ulid v1.3.1 go: downloading go.mongodb.org/mongo-driver v1.17.7 go: downloading github.com/go-openapi/errors v0.22.6 go: downloading github.com/go-viper/mapstructure/v2 v2.4.0 go: downloading github.com/leodido/go-urn v1.3.0 go: downloading github.com/go-playground/universal-translator v0.18.1 go: downloading github.com/gabriel-vasile/mimetype v1.4.3 go: downloading github.com/go-playground/locales v0.14.1 go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.4.19 go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.7.19 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.13.6 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.13.19 Running Suite: Red Hat App Studio E2E tests - /tmp/tmp.QooiWRKa1o/cmd ===================================================================== Random Seed: 1777979817 Will run 381 of 469 specs Running in parallel across 20 processes ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification tests that Release CR is created for the Snapshot [release-pipelines, rh-push-to-external-registry] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_push_to_external_registry.go:215 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification verifies a release PipelineRun is started and succeeded in managed namespace [release-pipelines, rh-push-to-external-registry] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_push_to_external_registry.go:226 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification validate the result of task create-pyxis-image contains image ids [release-pipelines, rh-push-to-external-registry] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_push_to_external_registry.go:233 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification tests that Release CR has completed [release-pipelines, rh-push-to-external-registry] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_push_to_external_registry.go:248 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification validates that imageIds from task create-pyxis-image exist in Pyxis. [release-pipelines, rh-push-to-external-registry] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_push_to_external_registry.go:265 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-host-pool] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:120 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-host-pool] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:124 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that a Release CR should have been created in the dev namespace [release-pipelines, push-to-external-registry] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/push_to_external_registry.go:157 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-host-pool] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:127 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that Release PipelineRun should eventually succeed [release-pipelines, push-to-external-registry] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/push_to_external_registry.go:164 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-host-pool] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:148 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created test that cleanup happened successfully [multi-platform, aws-host-pool] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:152 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context points to a file [build-templates] /tmp/tmp.QooiWRKa1o/tests/build/tkn-bundle.go:188 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles from specific context [build-templates] /tmp/tmp.QooiWRKa1o/tests/build/tkn-bundle.go:199 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:251 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification tests if the image was pushed to quay [release-pipelines, push-to-external-registry] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/push_to_external_registry.go:168 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context is the root directory [build-templates] /tmp/tmp.QooiWRKa1o/tests/build/tkn-bundle.go:209 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:255 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that a Release is marked as succeeded. [release-pipelines, push-to-external-registry] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/push_to_external_registry.go:175 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:259 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:123 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:128 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:132 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:136 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:178 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:183 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:187 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:191 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:233 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:238 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:242 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:246 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:286 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:291 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:295 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/fbc_release.go:299 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:263 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if release CR is created [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/release_to_github.go:138 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when context points to a file and a directory [build-templates] /tmp/tmp.QooiWRKa1o/tests/build/tkn-bundle.go:218 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, aws-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:267 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when using negation [build-templates] /tmp/tmp.QooiWRKa1o/tests/build/tkn-bundle.go:228 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies the release pipelinerun is running and succeeds [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/release_to_github.go:148 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmz-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:341 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding HOME environment variable [build-templates] /tmp/tmp.QooiWRKa1o/tests/build/tkn-bundle.go:238 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/release_to_github.go:181 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmz-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:345 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding STEP image [build-templates] /tmp/tmp.QooiWRKa1o/tests/build/tkn-bundle.go:247 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if the Release exists in github repo [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/release_to_github.go:192 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmz-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:349 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmz-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:353 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies if release CR is created [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_advisories.go:117 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmz-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:357 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies the advs release pipelinerun is running and succeeds [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_advisories.go:127 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmp-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:432 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_advisories.go:157 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmp-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:436 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies if the repository URL is valid [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_advisories.go:168 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmp-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:440 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies if the release CR is created [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_push_to_registry_redhat_io.go:108 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmp-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:444 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies the rhio release pipelinerun is running and succeeds [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_push_to_registry_redhat_io.go:118 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmp-dynamic] /tmp/tmp.QooiWRKa1o/tests/build/multi-platform.go:448 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_push_to_registry_redhat_io.go:148 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies if the MR URL is valid [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rh_push_to_registry_redhat_io.go:159 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies if the release CR is created [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rhtap_service_push.go:150 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies the rhtap release pipelinerun is running and succeeds [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rhtap_service_push.go:160 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies the release CR is created [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/multiarch_advisories.go:112 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rhtap_service_push.go:190 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies the multiarch release pipelinerun is running and succeeds [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/multiarch_advisories.go:122 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies if the PR in infra-deployments repo is created/updated [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/rhtap_service_push.go:200 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/multiarch_advisories.go:152 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies if the repository URL is valid [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.QooiWRKa1o/tests/release/pipelines/multiarch_advisories.go:163 ------------------------------ • [PANICKED] [9.280 seconds] [upgrade-suite Create users and check their state] [It] Verify AppStudioProvisionedUser [upgrade-verify] /tmp/tmp.QooiWRKa1o/tests/upgrade/verifyWorkload.go:20 Timeline >> "msg"="Observed a panic" "error"=null "panic"="runtime error: invalid memory address or nil pointer dereference" "panicGoValue"="\"invalid memory address or nil pointer dereference\"" "stacktrace"="goroutine 168 [running]:\nk8s.io/apimachinery/pkg/util/runtime.logPanic({0x49b0970, 0xc00134ad20}, {0x38766c0, 0x6eb48b0})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:132 +0xbc\nk8s.io/apimachinery/pkg/util/runtime.handleCrash({0x49b0a18, 0xc000178690}, {0x38766c0, 0x6eb48b0}, {0x0, 0x0, 0x4470a0?})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:107 +0x116\nk8s.io/apimachinery/pkg/util/runtime.HandleCrashWithContext({0x49b0a18, 0xc000178690}, {0x0, 0x0, 0x0})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:78 +0x5a\npanic({0x38766c0?, 0x6eb48b0?})\n\t/usr/lib/golang/src/runtime/panic.go:783 +0x132\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp.func1()\n\t/tmp/tmp.QooiWRKa1o/pkg/sandbox/sandbox.go:319 +0x35\ngithub.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval.func1({0xc000179401?, 0xc000145c18?})\n\t/tmp/tmp.QooiWRKa1o/pkg/utils/util.go:129 +0x13\nk8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1({0x49b0a18?, 0xc000178690?}, 0x49b0a18?)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:53 +0x62\nk8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext({0x49b0a18, 0xc000178690}, {0x499aa48, 0xc0003a8240}, 0x1, 0x0, 0xc000145d90)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:54 +0x115\nk8s.io/apimachinery/pkg/util/wait.PollUntilContextTimeout({0x49b08c8?, 0x6f77160?}, 0xee6b2800, 0x41d765?, 0x1, 0xc000145d90)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/poll.go:48 +0xa5\ngithub.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval(0xa?, 0xc000145dd8?, 0x1?)\n\t/tmp/tmp.QooiWRKa1o/pkg/utils/util.go:129 +0x45\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp(0x401d5ed?, {0x401d5ed?, 0x4019bbb?}, 0x8?)\n\t/tmp/tmp.QooiWRKa1o/pkg/sandbox/sandbox.go:318 +0x72\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreated(0x0, {0x401d5ed, 0x9})\n\t/tmp/tmp.QooiWRKa1o/pkg/sandbox/sandbox.go:314 +0x4b\ngithub.com/konflux-ci/e2e-tests/tests/upgrade/verify.VerifyAppStudioProvisionedUser(0x0?)\n\t/tmp/tmp.QooiWRKa1o/tests/upgrade/verify/verifyUsers.go:14 +0x25\ngithub.com/konflux-ci/e2e-tests/tests/upgrade.init.func1.2()\n\t/tmp/tmp.QooiWRKa1o/tests/upgrade/verifyWorkload.go:21 +0x1a\ngithub.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc000420f74?, 0xc000420ef0?})\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.0/internal/node.go:585 +0x13\ngithub.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.0/internal/suite.go:946 +0x393\ncreated by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 129\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.0/internal/suite.go:911 +0xd90\n" [PANICKED] in [It] - /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 @ 05/05/26 11:33:24.643 << Timeline [PANICKED] Test Panicked In [It] at: /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 @ 05/05/26 11:33:24.643 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/apimachinery/pkg/util/runtime.handleCrash({0x49b0a18, 0xc000178690}, {0x38766c0, 0x6eb48b0}, {0x0, 0x0, 0x4470a0?}) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 +0x1a9 k8s.io/apimachinery/pkg/util/runtime.HandleCrashWithContext({0x49b0a18, 0xc000178690}, {0x0, 0x0, 0x0}) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:78 +0x5a panic({0x38766c0?, 0x6eb48b0?}) /usr/lib/golang/src/runtime/panic.go:783 +0x132 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp.func1() /tmp/tmp.QooiWRKa1o/pkg/sandbox/sandbox.go:319 +0x35 github.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval.func1({0xc000179401?, 0xc000145c18?}) /tmp/tmp.QooiWRKa1o/pkg/utils/util.go:129 +0x13 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1({0x49b0a18?, 0xc000178690?}, 0x49b0a18?) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:53 +0x62 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext({0x49b0a18, 0xc000178690}, {0x499aa48, 0xc0003a8240}, 0x1, 0x0, 0xc002387d90) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:54 +0x115 k8s.io/apimachinery/pkg/util/wait.PollUntilContextTimeout({0x49b08c8?, 0x6f77160?}, 0xee6b2800, 0x41d765?, 0x1, 0xc000145d90) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/poll.go:48 +0xa5 github.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval(0xa?, 0xc000145dd8?, 0x1?) /tmp/tmp.QooiWRKa1o/pkg/utils/util.go:129 +0x45 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp(0x401d5ed?, {0x401d5ed?, 0x4019bbb?}, 0x8?) /tmp/tmp.QooiWRKa1o/pkg/sandbox/sandbox.go:318 +0x72 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreated(0x0, {0x401d5ed, 0x9}) /tmp/tmp.QooiWRKa1o/pkg/sandbox/sandbox.go:314 +0x4b github.com/konflux-ci/e2e-tests/tests/upgrade/verify.VerifyAppStudioProvisionedUser(0x0?) /tmp/tmp.QooiWRKa1o/tests/upgrade/verify/verifyUsers.go:14 +0x25 github.com/konflux-ci/e2e-tests/tests/upgrade.init.func1.2() /tmp/tmp.QooiWRKa1o/tests/upgrade/verifyWorkload.go:21 +0x1a ------------------------------ SS••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test build secret lookup when two secrets are created when second component is deleted, pac pr branch should not exist in the repo [build-service, github, pac-build, secret-lookup] /tmp/tmp.QooiWRKa1o/tests/build/secret_lookup.go:206 ------------------------------ •• ------------------------------ • [FAILED] [378.475 seconds] [build-service-suite Build service E2E tests] test git provider fj PaC component build [BeforeAll] when a new component without specified branch is created and with visibility private correctly targets the default branch (that is not named 'main') with PaC [build-service, github-webhook, pac-build, pipeline, image-controller, forgejo, pac-custom-default-branch] [BeforeAll] /tmp/tmp.QooiWRKa1o/tests/build/pac_build.go:54 [It] /tmp/tmp.QooiWRKa1o/tests/build/pac_build.go:136 [FAILED] Failed to fork repository for fj Unexpected error: <*fmt.wrapError | 0xc0006b80c0>: error migrating project konflux-qe/devfile-sample-hello-world to konflux-qe/devfile-sample-hello-world-ojpvgr (last error: ): context deadline exceeded { msg: "error migrating project konflux-qe/devfile-sample-hello-world to konflux-qe/devfile-sample-hello-world-ojpvgr (last error: ): context deadline exceeded", err: {}, } occurred In [BeforeAll] at: /tmp/tmp.QooiWRKa1o/tests/build/git_provider_config.go:329 @ 05/05/26 11:39:33.469 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider fj PaC component build when the PaC init branch is merged retrigger the pipeline manually [build-service, github-webhook, pac-build, pipeline, image-controller, forgejo, build-custom-branch] /tmp/tmp.QooiWRKa1o/tests/build/pac_build.go:600 ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider fj PaC component build when the PaC init branch is merged retriggered pipelineRun should eventually finish [build-service, github-webhook, pac-build, pipeline, image-controller, forgejo, build-custom-branch] /tmp/tmp.QooiWRKa1o/tests/build/pac_build.go:642 ------------------------------ SS ------------------------------ • [FAILED] [468.952 seconds] [build-service-suite Build service E2E tests] test git provider fj component update with renovate [BeforeAll] when components are created in same namespace creates component with nudges [build-service, renovate, multi-component, forgejo] [BeforeAll] /tmp/tmp.QooiWRKa1o/tests/build/renovate.go:72 [It] /tmp/tmp.QooiWRKa1o/tests/build/renovate.go:235 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.QooiWRKa1o/tests/build/renovate.go:131 @ 05/05/26 11:39:04.018 [FAILED] in [AfterAll] - /tmp/tmp.QooiWRKa1o/tests/build/renovate.go:230 @ 05/05/26 11:41:04.02 << Timeline [FAILED] Unexpected error: <*fmt.wrapError | 0xc0007be080>: error migrating project konflux-qe/build-nudge-parent to konflux-qe/build-nudge-parent-jvapse (last error: ): context deadline exceeded { msg: "error migrating project konflux-qe/build-nudge-parent to konflux-qe/build-nudge-parent-jvapse (last error: ): context deadline exceeded", err: {}, } occurred In [BeforeAll] at: /tmp/tmp.QooiWRKa1o/tests/build/renovate.go:131 @ 05/05/26 11:39:04.018 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSSSSSSSSSSSS••••••••• ------------------------------ • [FAILED] [481.146 seconds] [integration-service-suite Status Reporting of Integration tests] with status reporting of Integration tests in CheckRuns when a new Component with specified custom branch is created [It] should lead to build PipelineRun finishing successfully [integration-service, github-status-reporting, custom-branch] /tmp/tmp.QooiWRKa1o/tests/integration-service/status-reporting-to-pullrequest.go:144 Timeline >> PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: ResolvingTaskRef PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Running PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: PipelineRunStopping PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: PipelineRunStopping PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: PipelineRunStopping PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: PipelineRunStopping PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: PipelineRunStopping PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: PipelineRunStopping PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: PipelineRunStopping PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: PipelineRunStopping PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: PipelineRunStopping PipelineRun test-component-pac-suvqed-on-pull-request-zpck5 reason: Failed [FAILED] in [It] - /tmp/tmp.QooiWRKa1o/tests/integration-service/status-reporting-to-pullrequest.go:146 @ 05/05/26 11:43:08.202 << Timeline [FAILED] build pipelinerun fails for NameSpace/Application/Component stat-rep-hxrf/integ-app-rzhh/test-component-pac-suvqed with logs: Pipelinerun 'test-component-pac-suvqed-on-pull-request-zpck5' didn't succeed Expected success, but got an error: <*errors.errorString | 0xc0015228d0>: Pipelinerun 'test-component-pac-suvqed-on-pull-request-zpck5' didn't succeed { s: "Pipelinerun 'test-component-pac-suvqed-on-pull-request-zpck5' didn't succeed\n", } In [It] at: /tmp/tmp.QooiWRKa1o/tests/integration-service/status-reporting-to-pullrequest.go:146 @ 05/05/26 11:43:08.202 ------------------------------ SSSSSSSSSSSSSSSSSSSSSS•••••••••••••••••••••••••••••••••••••S•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build) when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.QooiWRKa1o/tests/build/build_templates.go:507 ------------------------------ • ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build) when the container image for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic is created and pushed to container registry verify-enterprise-contract check should pass [build, build-templates, HACBS, pipeline-service, pipeline, sbom, slow, build-templates-e2e] /tmp/tmp.QooiWRKa1o/tests/build/build_templates.go:569 ------------------------------ S ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build) build-definitions ec pipelines runs ec pipeline pipelines/enterprise-contract.yaml [build, build-templates, HACBS, pipeline-service, pipeline, build-templates-e2e] /tmp/tmp.QooiWRKa1o/tests/build/build_templates.go:744 ------------------------------ •••••••• ------------------------------ • [FAILED] [301.974 seconds] [integration-service-suite Gitlab Status Reporting of Integration tests] Gitlab with status reporting of Integration tests in the assosiated merge request when the PaC build pipelineRun run succeeded [It] checks if the Build PipelineRun got annotated with Snapshot name [integration-service, gitlab-status-reporting] /tmp/tmp.QooiWRKa1o/tests/integration-service/gitlab-integration-reporting.go:188 Timeline >> build pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yetbuild pipelinerun gitlab-rep-tizt/test-comp-pac-gitlab-fpmzxz-on-pull-request-zdzzk doesn't contain annotation appstudio.openshift.io/snapshot yet [FAILED] in [It] - /tmp/tmp.QooiWRKa1o/tests/integration-service/gitlab-integration-reporting.go:189 @ 05/05/26 11:49:18.218 << Timeline [FAILED] Expected success, but got an error: : context deadline exceeded {} In [It] at: /tmp/tmp.QooiWRKa1o/tests/integration-service/gitlab-integration-reporting.go:189 @ 05/05/26 11:49:18.218 ------------------------------ SSSSSSSSSSSSSS••••••••••••••••••••••••••••••S••S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta) when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build-oci-ta should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.QooiWRKa1o/tests/build/build_templates.go:507 ------------------------------ • ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta) when the container image for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic is created and pushed to container registry verify-enterprise-contract check should pass [build, build-templates, HACBS, pipeline-service, pipeline, sbom, slow, build-templates-e2e] /tmp/tmp.QooiWRKa1o/tests/build/build_templates.go:569 ------------------------------ S ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta) build-definitions ec pipelines runs ec pipeline pipelines/enterprise-contract.yaml [build, build-templates, HACBS, pipeline-service, pipeline, build-templates-e2e] /tmp/tmp.QooiWRKa1o/tests/build/build_templates.go:744 ------------------------------ •SS•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta-min) when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build-oci-ta-min should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.QooiWRKa1o/tests/build/build_templates.go:507 ------------------------------ • ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta-min) when the container image for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic is created and pushed to container registry verify-enterprise-contract check should pass [build, build-templates, HACBS, pipeline-service, pipeline, sbom, slow, build-templates-e2e] /tmp/tmp.QooiWRKa1o/tests/build/build_templates.go:569 ------------------------------ S ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta-min) build-definitions ec pipelines runs ec pipeline pipelines/enterprise-contract.yaml [build, build-templates, HACBS, pipeline-service, pipeline, build-templates-e2e] /tmp/tmp.QooiWRKa1o/tests/build/build_templates.go:744 ------------------------------ •••••••••••••••••••••••••••••••••••••••••••• ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider gh PaC component build when the PaC init branch is merged retrigger the pipeline manually [build-service, github-webhook, pac-build, pipeline, image-controller, github, build-custom-branch] /tmp/tmp.QooiWRKa1o/tests/build/pac_build.go:600 ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider gh PaC component build when the PaC init branch is merged retriggered pipelineRun should eventually finish [build-service, github-webhook, pac-build, pipeline, image-controller, github, build-custom-branch] /tmp/tmp.QooiWRKa1o/tests/build/pac_build.go:642 ------------------------------ •••••••••••••••• ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider gl PaC component build when the PaC init branch is merged retrigger the pipeline manually [build-service, github-webhook, pac-build, pipeline, image-controller, gitlab, build-custom-branch] /tmp/tmp.QooiWRKa1o/tests/build/pac_build.go:600 ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider gl PaC component build when the PaC init branch is merged retriggered pipelineRun should eventually finish [build-service, github-webhook, pac-build, pipeline, image-controller, gitlab, build-custom-branch] /tmp/tmp.QooiWRKa1o/tests/build/pac_build.go:642 ------------------------------ •••••••••••••• ------------------------------ • [FAILED] [20.342 seconds] [integration-service-suite Creation of group snapshots for monorepo and multiple repos] with status reporting of Integration tests in CheckRuns [AfterAll] when IntegrationTestScenario reference to task as pipelinerun resolution trigger pipelinerun for invalid integrationTestScenario by annotating snapshot and verify failing to create integration pipelinerun [integration-service, group-snapshot-creation] [AfterAll] /tmp/tmp.QooiWRKa1o/tests/integration-service/group-snapshots-tests.go:149 [It] /tmp/tmp.QooiWRKa1o/tests/integration-service/group-snapshots-tests.go:780 [FAILED] Expected success, but got an error: <*errors.StatusError | 0xc001946780>: snapshots.appstudio.redhat.com "integ-app-aeis-20260505-115200-000-tw" not found { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "snapshots.appstudio.redhat.com \"integ-app-aeis-20260505-115200-000-tw\" not found", Reason: "NotFound", Details: { Name: "integ-app-aeis-20260505-115200-000-tw", Group: "appstudio.redhat.com", Kind: "snapshots", UID: "", Causes: nil, RetryAfterSeconds: 0, }, Code: 404, }, } In [AfterAll] at: /tmp/tmp.QooiWRKa1o/tests/integration-service/integration.go:494 @ 05/05/26 12:09:39.582 ------------------------------ •• ------------------------------ • [FAILED] [1215.371 seconds] [build-service-suite Build service E2E tests] test git provider gl component update with renovate when components are created in same namespace [It] should lead to a nudge PR creation for child component [build-service, renovate, multi-component, gitlab] /tmp/tmp.QooiWRKa1o/tests/build/renovate.go:412 [FAILED] Timed out after 1200.000s. timed out when waiting for component nudge PR to be created in build-nudge-child-wqwzlw repository Expected : false to be true In [It] at: /tmp/tmp.QooiWRKa1o/tests/build/renovate.go:427 @ 05/05/26 12:09:33.788 ------------------------------ SS ------------------------------ • [FAILED] [124.364 seconds] [build-service-suite Build service E2E tests] test pac with multiple components using same repository when components are created in same namespace [It] the PipelineRun should eventually finish successfully for component python-component-updjtg [build-service, github, pac-build, multi-component] /tmp/tmp.QooiWRKa1o/tests/build/multi_component.go:159 Timeline >> PipelineRun python-component-updjtg-on-pull-request-bmpb9 found for Component build-e2e-ojzb/python-component-updjtg PipelineRun python-component-updjtg-on-pull-request-bmpb9 reason: Running PipelineRun python-component-updjtg-on-pull-request-bmpb9 reason: Running PipelineRun python-component-updjtg-on-pull-request-bmpb9 reason: Running PipelineRun python-component-updjtg-on-pull-request-bmpb9 reason: Failed attempt 1/3: PipelineRun "python-component-updjtg-on-pull-request-bmpb9" failed: pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | init container: prepare 2026/05/05 12:10:30 Entrypoint initialization pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | init container: place-scripts 2026/05/05 12:10:30 Decoded script /tekton/scripts/script-1-z2gqz 2026/05/05 12:10:30 Decoded script /tekton/scripts/script-2-xnm9c 2026/05/05 12:10:30 Decoded script /tekton/scripts/script-3-qnfks 2026/05/05 12:10:30 Decoded script /tekton/scripts/script-4-9stcn 2026/05/05 12:10:30 Decoded script /tekton/scripts/script-5-4shhv pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-use-trusted-artifact: Using token for quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg Executing: oras blob fetch --registry-config /tmp/use-oci.sh.zeyr8g/auth-iJiIXY.json quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg@sha256:86b47920a93a0a5693290a839c0e094a4235eeb4a4d06117dcf26e4b79c8039d --output - Error response from registry: unauthorized: access to the requested resource is not authorized: map[] warning: Command failed and will retry, 1 try error: Unauthorized error, wrong registry credentials provided, won't retry gzip: stdin: unexpected end of file tar: Child returned status 1 tar: Error is not recoverable: exiting now Command exited with non-zero status 2 pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-build: 2026/05/05 12:10:35 Skipping step because a previous step failed pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-push: 2026/05/05 12:10:35 Skipping step because a previous step failed pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-sbom-syft-generate: 2026/05/05 12:10:35 Skipping step because a previous step failed pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-prepare-sboms: 2026/05/05 12:10:35 Skipping step because a previous step failed pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-upload-sbom: 2026/05/05 12:10:36 Skipping step because a previous step failed pod: python-component-updjtg-on-9433995d80ba36ffe42263e0de296253-pod | init container: prepare 2026/05/05 12:09:35 Entrypoint initialization pod: python-component-updjtg-on-9433995d80ba36ffe42263e0de296253-pod | init container: place-scripts 2026/05/05 12:09:35 Decoded script /tekton/scripts/script-0-prd52 2026/05/05 12:09:35 Decoded script /tekton/scripts/script-1-gkfvg pod: python-component-updjtg-on-9433995d80ba36ffe42263e0de296253-pod | container step-clone: INFO: Using mounted CA bundle: /mnt/trusted-ca/ca-bundle.crt {"level":"info","ts":1777982979.681717,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777982979.936445,"caller":"git/git.go:223","msg":"Successfully cloned https://github.com/redhat-appstudio-qe/sample-multi-component @ 905dacdebfb83fad502a365a55872395ee5266e3 (grafted, HEAD) in path /var/workdir/source"} {"level":"info","ts":1777982979.9364934,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777982979.9619145,"caller":"git/git.go:277","msg":"Successfully initialized and updated submodules in path /var/workdir/source"} Merge option disabled. Using checked-out revision 905dacdebfb83fad502a365a55872395ee5266e3 directly. pod: python-component-updjtg-on-9433995d80ba36ffe42263e0de296253-pod | container step-symlink-check: Running symlink check pod: python-component-updjtg-on-9433995d80ba36ffe42263e0de296253-pod | container step-create-trusted-artifact: Prepared artifact from /var/workdir/source (sha256:86b47920a93a0a5693290a839c0e094a4235eeb4a4d06117dcf26e4b79c8039d) Using token for quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg Executing: oras push --annotation=quay.expires-after=6h --registry-config /tmp/create-oci.sh.trQAf2/auth-8salZJ.json quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg:on-pr-905dacdebfb83fad502a365a55872395ee5266e3.git SOURCE_ARTIFACT Uploading 86b47920a93a SOURCE_ARTIFACT Uploaded 86b47920a93a SOURCE_ARTIFACT Pushed [registry] quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg:on-pr-905dacdebfb83fad502a365a55872395ee5266e3.git ArtifactType: application/vnd.unknown.artifact.v1 Digest: sha256:489823dea5b20509ab5f71cc473898c1c24f74a27c8ff02259d9ffd90eed9d6a Artifacts created pod: python-component-updjtg-on-pull-request-bmpb9-init-pod | init container: prepare 2026/05/05 12:09:29 Entrypoint initialization pod: python-component-updjtg-on-pull-request-bmpb9-init-pod | container step-init: time="2026-05-05T12:09:32Z" level=info msg="[param] enable: false" time="2026-05-05T12:09:32Z" level=info msg="[param] default-http-proxy: squid.caching.svc.cluster.local:3128" time="2026-05-05T12:09:32Z" level=info msg="[param] default-no-proxy: brew.registry.redhat.io,docker.io,gcr.io,ghcr.io,images.paas.redhat.com,mirror.gcr.io,nvcr.io,quay.io,registry-proxy.engineering.redhat.com,registry.access.redhat.com,registry.ci.openshift.org,registry.fedoraproject.org,registry.redhat.io,registry.stage.redhat.io,vault.habana.ai" time="2026-05-05T12:09:32Z" level=info msg="[param] http-proxy-result-path: /tekton/results/http-proxy" time="2026-05-05T12:09:32Z" level=info msg="[param] no-proxy-result-path: /tekton/results/no-proxy" time="2026-05-05T12:09:32Z" level=info msg="Using in-cluster config" logger=KubeClient time="2026-05-05T12:09:32Z" level=info msg="Cache proxy is disabled via param" time="2026-05-05T12:09:32Z" level=info msg="[result] HTTP PROXY: " time="2026-05-05T12:09:32Z" level=info msg="[result] NO PROXY: " New PipelineRun python-component-updjtg-on-pull-request-kdkhd found after retrigger for component build-e2e-ojzb/python-component-updjtg PipelineRun python-component-updjtg-on-pull-request-kdkhd found for Component build-e2e-ojzb/python-component-updjtg PipelineRun python-component-updjtg-on-pull-request-kdkhd reason: Running PipelineRun python-component-updjtg-on-pull-request-kdkhd reason: Failed attempt 2/3: PipelineRun "python-component-updjtg-on-pull-request-kdkhd" failed: pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | init container: prepare 2026/05/05 12:10:55 Entrypoint initialization pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | init container: place-scripts 2026/05/05 12:10:55 Decoded script /tekton/scripts/script-0-656ts 2026/05/05 12:10:55 Decoded script /tekton/scripts/script-1-phsl8 pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-clone: INFO: Using mounted CA bundle: /mnt/trusted-ca/ca-bundle.crt {"level":"info","ts":1777983059.90269,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777983060.5415106,"caller":"git/git.go:223","msg":"Successfully cloned https://github.com/redhat-appstudio-qe/sample-multi-component @ e94670ad9bbfa92d9a3d9b3fea96a23376fa477f (grafted, HEAD) in path /var/workdir/source"} {"level":"info","ts":1777983060.5415561,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777983060.565456,"caller":"git/git.go:277","msg":"Successfully initialized and updated submodules in path /var/workdir/source"} Merge option disabled. Using checked-out revision e94670ad9bbfa92d9a3d9b3fea96a23376fa477f directly. pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-symlink-check: Running symlink check pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-create-trusted-artifact: Prepared artifact from /var/workdir/source (sha256:5e814275a67e328da1b483bd2e3da10a2a5521d856edd7dc09eb6f89ae15884e) Using token for quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg Executing: oras push --annotation=quay.expires-after=6h --registry-config /tmp/create-oci.sh.dysAMK/auth-X8ps7v.json quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg:on-pr-e94670ad9bbfa92d9a3d9b3fea96a23376fa477f.git SOURCE_ARTIFACT Error response from registry: recognizable error message not found: HEAD "https://quay.io/v2/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg/manifests/sha256:fb134d946d73fef5439e3113241fb32b3e39af1b9be9f6ea76f991112b86e6fc": response status code 401: Unauthorized warning: Command failed and will retry, 1 try error: Unauthorized error, wrong registry credentials provided, won't retry Command exited with non-zero status 1 pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | init container: prepare 2026/05/05 12:10:30 Entrypoint initialization pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | init container: place-scripts 2026/05/05 12:10:30 Decoded script /tekton/scripts/script-1-z2gqz 2026/05/05 12:10:30 Decoded script /tekton/scripts/script-2-xnm9c 2026/05/05 12:10:30 Decoded script /tekton/scripts/script-3-qnfks 2026/05/05 12:10:30 Decoded script /tekton/scripts/script-4-9stcn 2026/05/05 12:10:30 Decoded script /tekton/scripts/script-5-4shhv pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-use-trusted-artifact: Using token for quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg Executing: oras blob fetch --registry-config /tmp/use-oci.sh.zeyr8g/auth-iJiIXY.json quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg@sha256:86b47920a93a0a5693290a839c0e094a4235eeb4a4d06117dcf26e4b79c8039d --output - Error response from registry: unauthorized: access to the requested resource is not authorized: map[] warning: Command failed and will retry, 1 try error: Unauthorized error, wrong registry credentials provided, won't retry gzip: stdin: unexpected end of file tar: Child returned status 1 tar: Error is not recoverable: exiting now Command exited with non-zero status 2 pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-build: 2026/05/05 12:10:35 Skipping step because a previous step failed pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-push: 2026/05/05 12:10:35 Skipping step because a previous step failed pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-sbom-syft-generate: 2026/05/05 12:10:35 Skipping step because a previous step failed pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-prepare-sboms: 2026/05/05 12:10:35 Skipping step because a previous step failed pod: python-component-updjtg-on-933e31342758ffd4c2183abce4a18979-pod | container step-upload-sbom: 2026/05/05 12:10:36 Skipping step because a previous step failed pod: python-component-updjtg-on-9433995d80ba36ffe42263e0de296253-pod | init container: prepare 2026/05/05 12:09:35 Entrypoint initialization pod: python-component-updjtg-on-9433995d80ba36ffe42263e0de296253-pod | init container: place-scripts 2026/05/05 12:09:35 Decoded script /tekton/scripts/script-0-prd52 2026/05/05 12:09:35 Decoded script /tekton/scripts/script-1-gkfvg pod: python-component-updjtg-on-9433995d80ba36ffe42263e0de296253-pod | container step-clone: INFO: Using mounted CA bundle: /mnt/trusted-ca/ca-bundle.crt {"level":"info","ts":1777982979.681717,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777982979.936445,"caller":"git/git.go:223","msg":"Successfully cloned https://github.com/redhat-appstudio-qe/sample-multi-component @ 905dacdebfb83fad502a365a55872395ee5266e3 (grafted, HEAD) in path /var/workdir/source"} {"level":"info","ts":1777982979.9364934,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777982979.9619145,"caller":"git/git.go:277","msg":"Successfully initialized and updated submodules in path /var/workdir/source"} Merge option disabled. Using checked-out revision 905dacdebfb83fad502a365a55872395ee5266e3 directly. pod: python-component-updjtg-on-9433995d80ba36ffe42263e0de296253-pod | container step-symlink-check: Running symlink check pod: python-component-updjtg-on-9433995d80ba36ffe42263e0de296253-pod | container step-create-trusted-artifact: Prepared artifact from /var/workdir/source (sha256:86b47920a93a0a5693290a839c0e094a4235eeb4a4d06117dcf26e4b79c8039d) Using token for quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg Executing: oras push --annotation=quay.expires-after=6h --registry-config /tmp/create-oci.sh.trQAf2/auth-8salZJ.json quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg:on-pr-905dacdebfb83fad502a365a55872395ee5266e3.git SOURCE_ARTIFACT Uploading 86b47920a93a SOURCE_ARTIFACT Uploaded 86b47920a93a SOURCE_ARTIFACT Pushed [registry] quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg:on-pr-905dacdebfb83fad502a365a55872395ee5266e3.git ArtifactType: application/vnd.unknown.artifact.v1 Digest: sha256:489823dea5b20509ab5f71cc473898c1c24f74a27c8ff02259d9ffd90eed9d6a Artifacts created pod: python-component-updjtg-on-pull-request-bmpb9-init-pod | init container: prepare 2026/05/05 12:09:29 Entrypoint initialization pod: python-component-updjtg-on-pull-request-bmpb9-init-pod | container step-init: time="2026-05-05T12:09:32Z" level=info msg="[param] enable: false" time="2026-05-05T12:09:32Z" level=info msg="[param] default-http-proxy: squid.caching.svc.cluster.local:3128" time="2026-05-05T12:09:32Z" level=info msg="[param] default-no-proxy: brew.registry.redhat.io,docker.io,gcr.io,ghcr.io,images.paas.redhat.com,mirror.gcr.io,nvcr.io,quay.io,registry-proxy.engineering.redhat.com,registry.access.redhat.com,registry.ci.openshift.org,registry.fedoraproject.org,registry.redhat.io,registry.stage.redhat.io,vault.habana.ai" time="2026-05-05T12:09:32Z" level=info msg="[param] http-proxy-result-path: /tekton/results/http-proxy" time="2026-05-05T12:09:32Z" level=info msg="[param] no-proxy-result-path: /tekton/results/no-proxy" time="2026-05-05T12:09:32Z" level=info msg="Using in-cluster config" logger=KubeClient time="2026-05-05T12:09:32Z" level=info msg="Cache proxy is disabled via param" time="2026-05-05T12:09:32Z" level=info msg="[result] HTTP PROXY: " time="2026-05-05T12:09:32Z" level=info msg="[result] NO PROXY: " pod: python-component-updjtg-on-pull-request-kdkhd-init-pod | init container: prepare 2026/05/05 12:10:50 Entrypoint initialization pod: python-component-updjtg-on-pull-request-kdkhd-init-pod | container step-init: time="2026-05-05T12:10:52Z" level=info msg="[param] enable: false" time="2026-05-05T12:10:52Z" level=info msg="[param] default-http-proxy: squid.caching.svc.cluster.local:3128" time="2026-05-05T12:10:52Z" level=info msg="[param] default-no-proxy: brew.registry.redhat.io,docker.io,gcr.io,ghcr.io,images.paas.redhat.com,mirror.gcr.io,nvcr.io,quay.io,registry-proxy.engineering.redhat.com,registry.access.redhat.com,registry.ci.openshift.org,registry.fedoraproject.org,registry.redhat.io,registry.stage.redhat.io,vault.habana.ai" time="2026-05-05T12:10:52Z" level=info msg="[param] http-proxy-result-path: /tekton/results/http-proxy" time="2026-05-05T12:10:52Z" level=info msg="[param] no-proxy-result-path: /tekton/results/no-proxy" time="2026-05-05T12:10:52Z" level=info msg="Using in-cluster config" logger=KubeClient time="2026-05-05T12:10:52Z" level=info msg="Cache proxy is disabled via param" time="2026-05-05T12:10:52Z" level=info msg="[result] HTTP PROXY: " time="2026-05-05T12:10:52Z" level=info msg="[result] NO PROXY: " New PipelineRun python-component-updjtg-on-pull-request-bmpb9 found after retrigger for component build-e2e-ojzb/python-component-updjtg PipelineRun python-component-updjtg-on-pull-request-xhnzs found for Component build-e2e-ojzb/python-component-updjtg PipelineRun python-component-updjtg-on-pull-request-xhnzs reason: Running PipelineRun python-component-updjtg-on-pull-request-xhnzs reason: Failed attempt 3/3: PipelineRun "python-component-updjtg-on-pull-request-xhnzs" failed: pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | init container: prepare 2026/05/05 12:10:55 Entrypoint initialization pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | init container: place-scripts 2026/05/05 12:10:55 Decoded script /tekton/scripts/script-0-656ts 2026/05/05 12:10:55 Decoded script /tekton/scripts/script-1-phsl8 pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-clone: INFO: Using mounted CA bundle: /mnt/trusted-ca/ca-bundle.crt {"level":"info","ts":1777983059.90269,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777983060.5415106,"caller":"git/git.go:223","msg":"Successfully cloned https://github.com/redhat-appstudio-qe/sample-multi-component @ e94670ad9bbfa92d9a3d9b3fea96a23376fa477f (grafted, HEAD) in path /var/workdir/source"} {"level":"info","ts":1777983060.5415561,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777983060.565456,"caller":"git/git.go:277","msg":"Successfully initialized and updated submodules in path /var/workdir/source"} Merge option disabled. Using checked-out revision e94670ad9bbfa92d9a3d9b3fea96a23376fa477f directly. pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-symlink-check: Running symlink check pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-create-trusted-artifact: Prepared artifact from /var/workdir/source (sha256:5e814275a67e328da1b483bd2e3da10a2a5521d856edd7dc09eb6f89ae15884e) Using token for quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg Executing: oras push --annotation=quay.expires-after=6h --registry-config /tmp/create-oci.sh.dysAMK/auth-X8ps7v.json quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg:on-pr-e94670ad9bbfa92d9a3d9b3fea96a23376fa477f.git SOURCE_ARTIFACT Error response from registry: recognizable error message not found: HEAD "https://quay.io/v2/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg/manifests/sha256:fb134d946d73fef5439e3113241fb32b3e39af1b9be9f6ea76f991112b86e6fc": response status code 401: Unauthorized warning: Command failed and will retry, 1 try error: Unauthorized error, wrong registry credentials provided, won't retry Command exited with non-zero status 1 pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | init container: prepare 2026/05/05 12:11:27 Entrypoint initialization pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | init container: place-scripts 2026/05/05 12:11:28 Decoded script /tekton/scripts/script-0-8j29c 2026/05/05 12:11:28 Decoded script /tekton/scripts/script-1-lk5x2 pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | container step-clone: INFO: Using mounted CA bundle: /mnt/trusted-ca/ca-bundle.crt {"level":"info","ts":1777983092.321818,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777983092.6010404,"caller":"git/git.go:223","msg":"Successfully cloned https://github.com/redhat-appstudio-qe/sample-multi-component @ 6feeee5bf7520fc1f09f1f77f11111881e1b8cb3 (grafted, HEAD) in path /var/workdir/source"} {"level":"info","ts":1777983092.6010826,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777983092.6246512,"caller":"git/git.go:277","msg":"Successfully initialized and updated submodules in path /var/workdir/source"} Merge option disabled. Using checked-out revision 6feeee5bf7520fc1f09f1f77f11111881e1b8cb3 directly. pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | container step-symlink-check: Running symlink check pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | container step-create-trusted-artifact: Prepared artifact from /var/workdir/source (sha256:d79b94d0a691e3e2e8e37e1b2361a4a10306a6e310821ca5621d7af5db38566b) Using token for quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg Executing: oras push --annotation=quay.expires-after=6h --registry-config /tmp/create-oci.sh.laOqCr/auth-x06coq.json quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg:on-pr-6feeee5bf7520fc1f09f1f77f11111881e1b8cb3.git SOURCE_ARTIFACT Error response from registry: recognizable error message not found: HEAD "https://quay.io/v2/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg/manifests/sha256:868dedaa0d4358ea709915b830e897f79051fc76c386245fdcf1b7e12ce3bf42": response status code 401: Unauthorized warning: Command failed and will retry, 1 try error: Unauthorized error, wrong registry credentials provided, won't retry Command exited with non-zero status 1 pod: python-component-updjtg-on-pull-request-kdkhd-init-pod | init container: prepare 2026/05/05 12:10:50 Entrypoint initialization pod: python-component-updjtg-on-pull-request-kdkhd-init-pod | container step-init: time="2026-05-05T12:10:52Z" level=info msg="[param] enable: false" time="2026-05-05T12:10:52Z" level=info msg="[param] default-http-proxy: squid.caching.svc.cluster.local:3128" time="2026-05-05T12:10:52Z" level=info msg="[param] default-no-proxy: brew.registry.redhat.io,docker.io,gcr.io,ghcr.io,images.paas.redhat.com,mirror.gcr.io,nvcr.io,quay.io,registry-proxy.engineering.redhat.com,registry.access.redhat.com,registry.ci.openshift.org,registry.fedoraproject.org,registry.redhat.io,registry.stage.redhat.io,vault.habana.ai" time="2026-05-05T12:10:52Z" level=info msg="[param] http-proxy-result-path: /tekton/results/http-proxy" time="2026-05-05T12:10:52Z" level=info msg="[param] no-proxy-result-path: /tekton/results/no-proxy" time="2026-05-05T12:10:52Z" level=info msg="Using in-cluster config" logger=KubeClient time="2026-05-05T12:10:52Z" level=info msg="Cache proxy is disabled via param" time="2026-05-05T12:10:52Z" level=info msg="[result] HTTP PROXY: " time="2026-05-05T12:10:52Z" level=info msg="[result] NO PROXY: " pod: python-component-updjtg-on-pull-request-xhnzs-init-pod | init container: prepare 2026/05/05 12:11:21 Entrypoint initialization pod: python-component-updjtg-on-pull-request-xhnzs-init-pod | container step-init: time="2026-05-05T12:11:25Z" level=info msg="[param] enable: false" time="2026-05-05T12:11:25Z" level=info msg="[param] default-http-proxy: squid.caching.svc.cluster.local:3128" time="2026-05-05T12:11:25Z" level=info msg="[param] default-no-proxy: brew.registry.redhat.io,docker.io,gcr.io,ghcr.io,images.paas.redhat.com,mirror.gcr.io,nvcr.io,quay.io,registry-proxy.engineering.redhat.com,registry.access.redhat.com,registry.ci.openshift.org,registry.fedoraproject.org,registry.redhat.io,registry.stage.redhat.io,vault.habana.ai" time="2026-05-05T12:11:25Z" level=info msg="[param] http-proxy-result-path: /tekton/results/http-proxy" time="2026-05-05T12:11:25Z" level=info msg="[param] no-proxy-result-path: /tekton/results/no-proxy" time="2026-05-05T12:11:25Z" level=info msg="Using in-cluster config" logger=KubeClient time="2026-05-05T12:11:25Z" level=info msg="Cache proxy is disabled via param" time="2026-05-05T12:11:25Z" level=info msg="[result] HTTP PROXY: " time="2026-05-05T12:11:25Z" level=info msg="[result] NO PROXY: " [FAILED] in [It] - /tmp/tmp.QooiWRKa1o/tests/build/multi_component.go:161 @ 05/05/26 12:11:43.552 << Timeline [FAILED] Expected success, but got an error: <*errors.errorString | 0xc001296d60>: pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | init container: prepare 2026/05/05 12:10:55 Entrypoint initialization pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | init container: place-scripts 2026/05/05 12:10:55 Decoded script /tekton/scripts/script-0-656ts 2026/05/05 12:10:55 Decoded script /tekton/scripts/script-1-phsl8 pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-clone: INFO: Using mounted CA bundle: /mnt/trusted-ca/ca-bundle.crt {"level":"info","ts":1777983059.90269,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777983060.5415106,"caller":"git/git.go:223","msg":"Successfully cloned https://github.com/redhat-appstudio-qe/sample-multi-component @ e94670ad9bbfa92d9a3d9b3fea96a23376fa477f (grafted, HEAD) in path /var/workdir/source"} {"level":"info","ts":1777983060.5415561,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777983060.565456,"caller":"git/git.go:277","msg":"Successfully initialized and updated submodules in path /var/workdir/source"} Merge option disabled. Using checked-out revision e94670ad9bbfa92d9a3d9b3fea96a23376fa477f directly. pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-symlink-check: Running symlink check pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-create-trusted-artifact: Prepared artifact from /var/workdir/source (sha256:5e814275a67e328da1b483bd2e3da10a2a5521d856edd7dc09eb6f89ae15884e) Using token for quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg Executing: oras push --annotation=quay.expires-after=6h --registry-config /tmp/create-oci.sh.dysAMK/auth-X8ps7v.json quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg:on-pr-e94670ad9bbfa92d9a3d9b3fea96a23376fa477f.git SOURCE_ARTIFACT Error response from registry: recognizable error message not found: HEAD "https://quay.io/v2/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg/manifests/sha256:fb134d946d73fef5439e3113241fb32b3e39af1b9be9f6ea76f991112b86e6fc": response status code 401: Unauthorized warning: Command failed and will retry, 1 try error: Unauthorized error, wrong registry credentials provided, won't retry Command exited with non-zero status 1 pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | init container: prepare 2026/05/05 12:11:27 Entrypoint initialization pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | init container: place-scripts 2026/05/05 12:11:28 Decoded script /tekton/scripts/script-0-8j29c 2026/05/05 12:11:28 Decoded script /tekton/scripts/script-1-lk5x2 pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | container step-clone: INFO: Using mounted CA bundle: /mnt/trusted-ca/ca-bundle.crt {"level":"info","ts":1777983092.321818,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777983092.6010404,"caller":"git/git.go:223","msg":"Successfully cloned https://github.com/redhat-appstudio-qe/sample-multi-component @ 6feeee5bf7520fc1f09f1f77f11111881e1b8cb3 (grafted, HEAD) in path /var/workdir/source"} {"level":"info","ts":1777983092.6010826,"caller":"git/git.go:394","msg":"Retrying operation (attempt 1)"} {"level":"info","ts":1777983092.6246512,"caller":"git/git.go:277","msg":"Successfully initialized and updated submodules in path /var/workdir/source"} Merge option disabled. Using checked-out revision 6feeee5bf7520fc1f09f1f77f11111881e1b8cb3 directly. pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | container step-symlink-check: Running symlink check pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | container step-create-trusted-artifact: Prepared artifact from /var/workdir/source (sha256:d79b94d0a691e3e2e8e37e1b2361a4a10306a6e310821ca5621d7af5db38566b) Using token for quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg Executing: oras push --annotation=quay.expires-after=6h --registry-config /tmp/create-oci.sh.laOqCr/auth-x06coq.json quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg:on-pr-6feeee5bf7520fc1f09f1f77f11111881e1b8cb3.git SOURCE_ARTIFACT Error response from registry: recognizable error message not found: HEAD "https://quay.io/v2/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg/manifests/sha256:868dedaa0d4358ea709915b830e897f79051fc76c386245fdcf1b7e12ce3bf42": response status code 401: Unauthorized warning: Command failed and will retry, 1 try error: Unauthorized error, wrong registry credentials provided, won't retry Command exited with non-zero status 1 pod: python-component-updjtg-on-pull-request-kdkhd-init-pod | init container: prepare 2026/05/05 12:10:50 Entrypoint initialization pod: python-component-updjtg-on-pull-request-kdkhd-init-pod | container step-init: time="2026-05-05T12:10:52Z" level=info msg="[param] enable: false" time="2026-05-05T12:10:52Z" level=info msg="[param] default-http-proxy: squid.caching.svc.cluster.local:3128" time="2026-05-05T12:10:52Z" level=info msg="[param] default-no-proxy: brew.registry.redhat.io,docker.io,gcr.io,ghcr.io,images.paas.redhat.com,mirror.gcr.io,nvcr.io,quay.io,registry-proxy.engineering.redhat.com,registry.access.redhat.com,registry.ci.openshift.org,registry.fedoraproject.org,registry.redhat.io,registry.stage.redhat.io,vault.habana.ai" time="2026-05-05T12:10:52Z" level=info msg="[param] http-proxy-result-path: /tekton/results/http-proxy" time="2026-05-05T12:10:52Z" level=info msg="[param] no-proxy-result-path: /tekton/results/no-proxy" time="2026-05-05T12:10:52Z" level=info msg="Using in-cluster config" logger=KubeClient time="2026-05-05T12:10:52Z" level=info msg="Cache proxy is disabled via param" time="2026-05-05T12:10:52Z" level=info msg="[result] HTTP PROXY: " time="2026-05-05T12:10:52Z" level=info msg="[result] NO PROXY: " pod: python-component-updjtg-on-pull-request-xhnzs-init-pod | init container: prepare 2026/05/05 12:11:21 Entrypoint initialization pod: python-component-updjtg-on-pull-request-xhnzs-init-pod | container step-init: time="2026-05-05T12:11:25Z" level=info msg="[param] enable: false" time="2026-05-05T12:11:25Z" level=info msg="[param] default-http-proxy: squid.caching.svc.cluster.local:3128" time="2026-05-05T12:11:25Z" level=info msg="[param] default-no-proxy: brew.registry.redhat.io,docker.io,gcr.io,ghcr.io,images.paas.redhat.com,mirror.gcr.io,nvcr.io,quay.io,registry-proxy.engineering.redhat.com,registry.access.redhat.com,registry.ci.openshift.org,registry.fedoraproject.org,registry.redhat.io,registry.stage.redhat.io,vault.habana.ai" time="2026-05-05T12:11:25Z" level=info msg="[param] http-proxy-result-path: /tekton/results/http-proxy" time="2026-05-05T12:11:25Z" level=info msg="[param] no-proxy-result-path: /tekton/results/no-proxy" time="2026-05-05T12:11:25Z" level=info msg="Using in-cluster config" logger=KubeClient time="2026-05-05T12:11:25Z" level=info msg="Cache proxy is disabled via param" time="2026-05-05T12:11:25Z" level=info msg="[result] HTTP PROXY: " time="2026-05-05T12:11:25Z" level=info msg="[result] NO PROXY: " { s: "\n pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | init container: prepare\n2026/05/05 12:10:55 Entrypoint initialization\n\n pod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | init container: place-scripts\n2026/05/05 12:10:55 Decoded script /tekton/scripts/script-0-656ts\n2026/05/05 12:10:55 Decoded script /tekton/scripts/script-1-phsl8\n\npod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-clone: \nINFO: Using mounted CA bundle: /mnt/trusted-ca/ca-bundle.crt\n{\"level\":\"info\",\"ts\":1777983059.90269,\"caller\":\"git/git.go:394\",\"msg\":\"Retrying operation (attempt 1)\"}\n{\"level\":\"info\",\"ts\":1777983060.5415106,\"caller\":\"git/git.go:223\",\"msg\":\"Successfully cloned https://github.com/redhat-appstudio-qe/sample-multi-component @ e94670ad9bbfa92d9a3d9b3fea96a23376fa477f (grafted, HEAD) in path /var/workdir/source\"}\n{\"level\":\"info\",\"ts\":1777983060.5415561,\"caller\":\"git/git.go:394\",\"msg\":\"Retrying operation (attempt 1)\"}\n{\"level\":\"info\",\"ts\":1777983060.565456,\"caller\":\"git/git.go:277\",\"msg\":\"Successfully initialized and updated submodules in path /var/workdir/source\"}\nMerge option disabled. Using checked-out revision e94670ad9bbfa92d9a3d9b3fea96a23376fa477f directly.\n\npod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-symlink-check: \nRunning symlink check\n\npod: python-component-updjtg-on-8304488c03b6a9c09c06b94e99c07bd1-pod | container step-create-trusted-artifact: \nPrepared artifact from /var/workdir/source (sha256:5e814275a67e328da1b483bd2e3da10a2a5521d856edd7dc09eb6f89ae15884e)\nUsing token for quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg\nExecuting: oras push --annotation=quay.expires-after=6h --registry-config /tmp/create-oci.sh.dysAMK/auth-X8ps7v.json quay.io/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg:on-pr-e94670ad9bbfa92d9a3d9b3fea96a23376fa477f.git SOURCE_ARTIFACT\nError response from registry: recognizable error message not found: HEAD \"https://quay.io/v2/redhat-appstudio-qe/build-e2e-ojzb/python-component-updjtg/manifests/sha256:fb134d946d73fef5439e3113241fb32b3e39af1b9be9f6ea76f991112b86e6fc\": response status code 401: Unauthorized\nwarning: Command failed and will retry, 1 try\nerror: Unauthorized error, wrong registry credentials provided, won't retry\nCommand exited with non-zero status 1\n\n\n pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | init container: prepare\n2026/05/05 12:11:27 Entrypoint initialization\n\n pod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | init container: place-scripts\n2026/05/05 12:11:28 Decoded script /tekton/scripts/script-0-8j29c\n2026/05/05 12:11:28 Decoded script /tekton/scripts/script-1-lk5x2\n\npod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | container step-clone: \nINFO: Using mounted CA bundle: /mnt/trusted-ca/ca-bundle.crt\n{\"level\":\"info\",\"ts\":1777983092.321818,\"caller\":\"git/git.go:394\",\"msg\":\"Retrying operation (attempt 1)\"}\n{\"level\":\"info\",\"ts\":1777983092.6010404,\"caller\":\"git/git.go:223\",\"msg\":\"Successfully cloned https://github.com/redhat-appstudio-qe/sample-multi-component @ 6feeee5bf7520fc1f09f1f77f11111881e1b8cb3 (grafted, HEAD) in path /var/workdir/source\"}\n{\"level\":\"info\",\"ts\":1777983092.6010826,\"caller\":\"git/git.go:394\",\"msg\":\"Retrying operation (attempt 1)\"}\n{\"level\":\"info\",\"ts\":1777983092.6246512,\"caller\":\"git/git.go:277\",\"msg\":\"Successfully initialized and updated submodules in path /var/workdir/source\"}\nMerge option disabled. Using checked-out revision 6feeee5bf7520fc1f09f1f77f11111881e1b8cb3 directly.\n\npod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | container step-symlink-check: \nRunning symlink check\n\npod: python-component-updjtg-on-bf3a9cd1ba36fb89114b8d4d15c26f67-pod | container step-create-t... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output In [It] at: /tmp/tmp.QooiWRKa1o/tests/build/multi_component.go:161 @ 05/05/26 12:11:43.552 ------------------------------ SSSSS• ------------------------------ • [TIMEDOUT] [2932.848 seconds] [disaster-recovery DR Suite] DR Backwards-Compat when creating tenants on the old Konflux version [It] should wait for all build PipelineRuns to succeed [disaster-recovery, Serial] /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/dr_backwards_compat.go:74 Timeline >> STEP: Waiting for per-component build → test chains across all tenants @ 05/05/26 12:11:53.374 STEP: Waiting for build PipelineRun for mathwizz-frontend in dr-test-moshekipod-backwards-compat-dr (base: 0) @ 05/05/26 12:11:53.374 STEP: Waiting for build PipelineRun for mathwizz-frontend in dr-test-kokohazamar-backwards-compat-dr (base: 0) @ 05/05/26 12:11:53.374 STEP: Waiting for build PipelineRun for mathwizz-web-server in dr-test-moshekipod-backwards-compat-dr (base: 0) @ 05/05/26 12:11:53.374 STEP: Waiting for build PipelineRun for mathwizz-history-worker in dr-test-kokohazamar-backwards-compat-dr (base: 0) @ 05/05/26 12:11:53.374 STEP: Waiting for build PipelineRun for mathwizz-history-worker in dr-test-moshekipod-backwards-compat-dr (base: 0) @ 05/05/26 12:11:53.374 STEP: Waiting for build PipelineRun for mathwizz-web-server in dr-test-kokohazamar-backwards-compat-dr (base: 0) @ 05/05/26 12:11:53.374 namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 1/1 build PipelineRuns succeeded STEP: Waiting for test PipelineRun for mathwizz-history-worker in dr-test-moshekipod-backwards-compat-dr (base: 0) @ 05/05/26 12:16:53.617 namespace dr-test-moshekipod-backwards-compat-dr: 1/1 build PipelineRuns succeeded STEP: Waiting for test PipelineRun for mathwizz-frontend in dr-test-moshekipod-backwards-compat-dr (base: 0) @ 05/05/26 12:16:53.618 namespace dr-test-kokohazamar-backwards-compat-dr: 1/1 build PipelineRuns succeeded STEP: Waiting for test PipelineRun for mathwizz-history-worker in dr-test-kokohazamar-backwards-compat-dr (base: 0) @ 05/05/26 12:16:53.619 namespace dr-test-kokohazamar-backwards-compat-dr: 1/1 build PipelineRuns succeeded STEP: Waiting for test PipelineRun for mathwizz-frontend in dr-test-kokohazamar-backwards-compat-dr (base: 0) @ 05/05/26 12:16:53.621 namespace dr-test-kokohazamar-backwards-compat-dr: 1/1 build PipelineRuns succeeded STEP: Waiting for test PipelineRun for mathwizz-web-server in dr-test-kokohazamar-backwards-compat-dr (base: 0) @ 05/05/26 12:16:53.622 namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 build PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 1/1 build PipelineRuns succeeded STEP: Waiting for test PipelineRun for mathwizz-web-server in dr-test-moshekipod-backwards-compat-dr (base: 0) @ 05/05/26 12:17:23.638 namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-kokohazamar-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded namespace dr-test-moshekipod-backwards-compat-dr: 0/1 test PipelineRuns succeeded [TIMEDOUT] in [It] - /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/dr_backwards_compat.go:74 @ 05/05/26 13:00:44.578 Deleting fork repo DR-MathWizz-dzscwy for tenant dr-test-kokohazamar-backwards-compat-dr Deleting fork repo DR-MathWizz-tlusuz for tenant dr-test-moshekipod-backwards-compat-dr STEP: Collecting Velero pod information @ 05/05/26 13:00:46.199 Velero pod: node-agent-685wj | Phase: Running | Ready: true Velero pod: node-agent-d4h8v | Phase: Running | Ready: true Velero pod: node-agent-hqzvc | Phase: Running | Ready: true Velero pod: velero-5498cfc4db-7k8bz | Phase: Running | Ready: true STEP: Collecting Backup CR status for tenant "dr-test-kokohazamar-backwards-compat-dr" @ 05/05/26 13:00:46.206 WARNING: could not get Backup CR "backup-kokohazamar-backwards-compat-dr": backups.velero.io "backup-kokohazamar-backwards-compat-dr" not found STEP: Collecting Restore CR status for tenant "dr-test-kokohazamar-backwards-compat-dr" @ 05/05/26 13:00:46.21 WARNING: could not get Restore CR "restore-backup-kokohazamar-backwards-compat-dr": restores.velero.io "restore-backup-kokohazamar-backwards-compat-dr" not found STEP: Collecting Backup CR status for tenant "dr-test-moshekipod-backwards-compat-dr" @ 05/05/26 13:00:46.214 WARNING: could not get Backup CR "backup-moshekipod-backwards-compat-dr": backups.velero.io "backup-moshekipod-backwards-compat-dr" not found STEP: Collecting Restore CR status for tenant "dr-test-moshekipod-backwards-compat-dr" @ 05/05/26 13:00:46.218 WARNING: could not get Restore CR "restore-backup-moshekipod-backwards-compat-dr": restores.velero.io "restore-backup-moshekipod-backwards-compat-dr" not found << Timeline [TIMEDOUT] A suite timeout occurred In [It] at: /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/dr_backwards_compat.go:74 @ 05/05/26 13:00:44.578 This is the Progress Report generated when the suite timeout occurred: [disaster-recovery DR Suite] DR Backwards-Compat when creating tenants on the old Konflux version should wait for all build PipelineRuns to succeed (Spec Runtime: 48m51.204s) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/dr_backwards_compat.go:74 In [It] (Node Runtime: 48m51.204s) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/dr_backwards_compat.go:74 At [By Step] Waiting for test PipelineRun for mathwizz-web-server in dr-test-moshekipod-backwards-compat-dr (base: 0) (Step Runtime: 43m20.94s) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:201 Spec Goroutine goroutine 722 [sync.WaitGroup.Wait, 49 minutes] sync.runtime_SemacquireWaitGroup(0xc001f6bb80?, 0xc0?) /usr/lib/golang/src/runtime/sema.go:114 sync.(*WaitGroup).Wait(0xc001f653b0) /usr/lib/golang/src/sync/waitgroup.go:206 > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains(0xc001a35600, {0xc00117b5c0, 0x2, 0xc000421ea0?}, 0x0, 0x0) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:208 | } | } > wg.Wait() | | // Release PipelineRuns run in the managed namespace and may not map 1:1 > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.defineBackwardsCompatSpecs.func1.2.2() /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/dr_backwards_compat.go:75 | | It("should wait for all build PipelineRuns to succeed", func() { > waitForPipelineChains(fw, bcTenants, nil, nil) | }) | github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0x2698b?, 0x3?}) /opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.0/internal/node.go:585 github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3() /opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.0/internal/suite.go:946 github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 98 /opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.0/internal/suite.go:911 Goroutines of Interest goroutine 723 [select] github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc000786930, {0x4995648, 0xc00133b000}, 0x1, {0xc00195c640, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:558 github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc000786930, {0x4995648, 0xc00133b000}, {0xc00195c640, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:145 > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForSucceededPRCount(0xc001a35600, {0x409e542, 0x27}, {0x40099c7, 0x4}, {0x4042777, 0x13}, 0x1, 0x4e94914f000, 0x6fc23ac00) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:137 | namespace, succeededCount, expectedCount, displayType) | return succeededCount > }, timeout, poll).Should(Equal(expectedCount), | "expected %d successful %s PipelineRuns in namespace %s", | expectedCount, displayType, namespace) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains.func1({{0x409e542, 0x27}, {0x40cbb6d, 0x2f}, {0x4075a73, 0x1f}, {0x40995aa, 0x26}, {0xc001d9c720, 0x12}, ...}, ...) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:203 | By(fmt.Sprintf("Waiting for test PipelineRun for %s in %s (base: %d)", | component.Name, tenant.Namespace, base.test)) > waitForSucceededPRCount(fw, tenant.Namespace, "test", component.Name, | base.test+1, PipelineTimeout, PipelinePoll) | }(t, comp) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains in goroutine 722 /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:189 | for _, comp := range Components { | wg.Add(1) > go func(tenant Tenant, component ComponentDef) { | defer GinkgoRecover() | defer wg.Done() goroutine 724 [select] github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc0003d7880, {0x4995648, 0xc0012e8bc0}, 0x1, {0xc001840cc0, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:558 github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc0003d7880, {0x4995648, 0xc0012e8bc0}, {0xc001840cc0, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:145 > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForSucceededPRCount(0xc001a35600, {0x409e542, 0x27}, {0x40099c7, 0x4}, {0x4052e5b, 0x17}, 0x1, 0x4e94914f000, 0x6fc23ac00) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:137 | namespace, succeededCount, expectedCount, displayType) | return succeededCount > }, timeout, poll).Should(Equal(expectedCount), | "expected %d successful %s PipelineRuns in namespace %s", | expectedCount, displayType, namespace) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains.func1({{0x409e542, 0x27}, {0x40cbb6d, 0x2f}, {0x4075a73, 0x1f}, {0x40995aa, 0x26}, {0xc001d9c720, 0x12}, ...}, ...) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:203 | By(fmt.Sprintf("Waiting for test PipelineRun for %s in %s (base: %d)", | component.Name, tenant.Namespace, base.test)) > waitForSucceededPRCount(fw, tenant.Namespace, "test", component.Name, | base.test+1, PipelineTimeout, PipelinePoll) | }(t, comp) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains in goroutine 722 /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:189 | for _, comp := range Components { | wg.Add(1) > go func(tenant Tenant, component ComponentDef) { | defer GinkgoRecover() | defer wg.Done() goroutine 728 [select] github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc0007861c0, {0x4995648, 0xc00133a130}, 0x1, {0xc00182dac0, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:558 github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc0007861c0, {0x4995648, 0xc00133a130}, {0xc00182dac0, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:145 > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForSucceededPRCount(0xc001a35600, {0x40995d0, 0x26}, {0x40099c7, 0x4}, {0x4039a04, 0x11}, 0x1, 0x4e94914f000, 0x6fc23ac00) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:137 | namespace, succeededCount, expectedCount, displayType) | return succeededCount > }, timeout, poll).Should(Equal(expectedCount), | "expected %d successful %s PipelineRuns in namespace %s", | expectedCount, displayType, namespace) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains.func1({{0x40995d0, 0x26}, {0x40c598f, 0x2e}, {0x4071a27, 0x1e}, {0x40944da, 0x25}, {0xc002901fb0, 0x12}, ...}, ...) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:203 | By(fmt.Sprintf("Waiting for test PipelineRun for %s in %s (base: %d)", | component.Name, tenant.Namespace, base.test)) > waitForSucceededPRCount(fw, tenant.Namespace, "test", component.Name, | base.test+1, PipelineTimeout, PipelinePoll) | }(t, comp) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains in goroutine 722 /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:189 | for _, comp := range Components { | wg.Add(1) > go func(tenant Tenant, component ComponentDef) { | defer GinkgoRecover() | defer wg.Done() goroutine 727 [select] github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc0003d6cb0, {0x4995648, 0xc001359b60}, 0x1, {0xc000de5f00, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:558 github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc0003d6cb0, {0x4995648, 0xc001359b60}, {0xc000de5f00, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:145 > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForSucceededPRCount(0xc001a35600, {0x40995d0, 0x26}, {0x40099c7, 0x4}, {0x4052e5b, 0x17}, 0x1, 0x4e94914f000, 0x6fc23ac00) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:137 | namespace, succeededCount, expectedCount, displayType) | return succeededCount > }, timeout, poll).Should(Equal(expectedCount), | "expected %d successful %s PipelineRuns in namespace %s", | expectedCount, displayType, namespace) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains.func1({{0x40995d0, 0x26}, {0x40c598f, 0x2e}, {0x4071a27, 0x1e}, {0x40944da, 0x25}, {0xc002901fb0, 0x12}, ...}, ...) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:203 | By(fmt.Sprintf("Waiting for test PipelineRun for %s in %s (base: %d)", | component.Name, tenant.Namespace, base.test)) > waitForSucceededPRCount(fw, tenant.Namespace, "test", component.Name, | base.test+1, PipelineTimeout, PipelinePoll) | }(t, comp) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains in goroutine 722 /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:189 | for _, comp := range Components { | wg.Add(1) > go func(tenant Tenant, component ComponentDef) { | defer GinkgoRecover() | defer wg.Done() goroutine 726 [select] github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc00077f490, {0x4995648, 0xc00288d7f0}, 0x1, {0xc0019b1800, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:558 github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc00077f490, {0x4995648, 0xc00288d7f0}, {0xc0019b1800, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:145 > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForSucceededPRCount(0xc001a35600, {0x40995d0, 0x26}, {0x40099c7, 0x4}, {0x4042777, 0x13}, 0x1, 0x4e94914f000, 0x6fc23ac00) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:137 | namespace, succeededCount, expectedCount, displayType) | return succeededCount > }, timeout, poll).Should(Equal(expectedCount), | "expected %d successful %s PipelineRuns in namespace %s", | expectedCount, displayType, namespace) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains.func1({{0x40995d0, 0x26}, {0x40c598f, 0x2e}, {0x4071a27, 0x1e}, {0x40944da, 0x25}, {0xc002901fb0, 0x12}, ...}, ...) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:203 | By(fmt.Sprintf("Waiting for test PipelineRun for %s in %s (base: %d)", | component.Name, tenant.Namespace, base.test)) > waitForSucceededPRCount(fw, tenant.Namespace, "test", component.Name, | base.test+1, PipelineTimeout, PipelinePoll) | }(t, comp) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains in goroutine 722 /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:189 | for _, comp := range Components { | wg.Add(1) > go func(tenant Tenant, component ComponentDef) { | defer GinkgoRecover() | defer wg.Done() goroutine 725 [select] github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc0006dc770, {0x4995648, 0xc00288c060}, 0x1, {0xc001841e80, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:558 github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc0006dc770, {0x4995648, 0xc00288c060}, {0xc001841e80, 0x4, 0x4}) /opt/app-root/src/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:145 > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForSucceededPRCount(0xc001a35600, {0x409e542, 0x27}, {0x40099c7, 0x4}, {0x4039a04, 0x11}, 0x1, 0x4e94914f000, 0x6fc23ac00) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:137 | namespace, succeededCount, expectedCount, displayType) | return succeededCount > }, timeout, poll).Should(Equal(expectedCount), | "expected %d successful %s PipelineRuns in namespace %s", | expectedCount, displayType, namespace) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains.func1({{0x409e542, 0x27}, {0x40cbb6d, 0x2f}, {0x4075a73, 0x1f}, {0x40995aa, 0x26}, {0xc001d9c720, 0x12}, ...}, ...) /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:203 | By(fmt.Sprintf("Waiting for test PipelineRun for %s in %s (base: %d)", | component.Name, tenant.Namespace, base.test)) > waitForSucceededPRCount(fw, tenant.Namespace, "test", component.Name, | base.test+1, PipelineTimeout, PipelinePoll) | }(t, comp) > github.com/konflux-ci/e2e-tests/tests/disaster-recovery.waitForPipelineChains in goroutine 722 /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/tenant_application_lifecycle.go:189 | for _, comp := range Components { | wg.Add(1) > go func(tenant Tenant, component ComponentDef) { | defer GinkgoRecover() | defer wg.Done() ------------------------------ SSSSSSSSSSSSSSSSSSS Summarizing 9 Failures: [PANICKED!] [upgrade-suite Create users and check their state] [It] Verify AppStudioProvisionedUser [upgrade-verify] /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 [FAIL] [build-service-suite Build service E2E tests] test git provider fj PaC component build [BeforeAll] when a new component without specified branch is created and with visibility private correctly targets the default branch (that is not named 'main') with PaC [build-service, github-webhook, pac-build, pipeline, image-controller, forgejo, pac-custom-default-branch] /tmp/tmp.QooiWRKa1o/tests/build/git_provider_config.go:329 [FAIL] [build-service-suite Build service E2E tests] test git provider fj component update with renovate [BeforeAll] when components are created in same namespace creates component with nudges [build-service, renovate, multi-component, forgejo] /tmp/tmp.QooiWRKa1o/tests/build/renovate.go:131 [FAIL] [integration-service-suite Status Reporting of Integration tests] with status reporting of Integration tests in CheckRuns when a new Component with specified custom branch is created [It] should lead to build PipelineRun finishing successfully [integration-service, github-status-reporting, custom-branch] /tmp/tmp.QooiWRKa1o/tests/integration-service/status-reporting-to-pullrequest.go:146 [FAIL] [integration-service-suite Gitlab Status Reporting of Integration tests] Gitlab with status reporting of Integration tests in the assosiated merge request when the PaC build pipelineRun run succeeded [It] checks if the Build PipelineRun got annotated with Snapshot name [integration-service, gitlab-status-reporting] /tmp/tmp.QooiWRKa1o/tests/integration-service/gitlab-integration-reporting.go:189 [FAIL] [build-service-suite Build service E2E tests] test git provider gl component update with renovate when components are created in same namespace [It] should lead to a nudge PR creation for child component [build-service, renovate, multi-component, gitlab] /tmp/tmp.QooiWRKa1o/tests/build/renovate.go:427 [FAIL] [build-service-suite Build service E2E tests] test pac with multiple components using same repository when components are created in same namespace [It] the PipelineRun should eventually finish successfully for component python-component-updjtg [build-service, github, pac-build, multi-component] /tmp/tmp.QooiWRKa1o/tests/build/multi_component.go:161 [FAIL] [integration-service-suite Creation of group snapshots for monorepo and multiple repos] with status reporting of Integration tests in CheckRuns [AfterAll] when IntegrationTestScenario reference to task as pipelinerun resolution trigger pipelinerun for invalid integrationTestScenario by annotating snapshot and verify failing to create integration pipelinerun [integration-service, group-snapshot-creation] /tmp/tmp.QooiWRKa1o/tests/integration-service/integration.go:494 [TIMEDOUT] [disaster-recovery DR Suite] DR Backwards-Compat when creating tenants on the old Konflux version [It] should wait for all build PipelineRuns to succeed [disaster-recovery, Serial] /tmp/tmp.QooiWRKa1o/tests/disaster-recovery/dr_backwards_compat.go:74 Ran 266 of 469 Specs in 5251.557 seconds FAIL! - Suite Timeout Elapsed -- 257 Passed | 9 Failed | 88 Pending | 115 Skipped Ginkgo ran 1 suite in 1h30m3.357770664s Test Suite Failed Error: running "ginkgo --seed=1777979817 --timeout=1h30m0s --grace-period=30s --output-interceptor-mode=none --no-color --json-report=e2e-report.json --junit-report=e2e-report.xml --procs=20 --nodes=20 --p --output-dir=/workspace/artifact-dir ./cmd --" failed with exit code 1 make: *** [Makefile:25: ci/test/e2e] Error 1