./mage -v ci:teste2e Running target: CI:TestE2E I0429 14:01:16.145332 19486 magefile.go:526] setting up new custom bundle for testing... I0429 14:01:16.534333 19486 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777471276-jolk -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: docker-build to image I0429 14:01:18.037448 19486 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777471276-jolk: quay.io/redhat-appstudio-qe/test-images@sha256:5eb8475113de632070abe41229565c37e967f1bdc0f8d60e20e78d8323774bb9 I0429 14:01:18.037474 19486 magefile.go:532] To use the custom docker bundle locally, run below cmd: export CUSTOM_DOCKER_BUILD_PIPELINE_BUNDLE=quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777471276-jolk I0429 14:01:18.037496 19486 build_service.go:50] checking if repository is build-service I0429 14:01:18.037504 19486 e2e_repo.go:347] checking if repository is e2e-tests I0429 14:01:18.037508 19486 e2e_repo.go:335] multi-platform tests and require sprayproxy registering are set to TRUE exec: git "diff" "--name-status" "upstream/main..HEAD" I0429 14:01:18.040693 19486 util.go:451] The following files, magefiles/magefile.go, tests/disaster-recovery/backup_infra.go, tests/disaster-recovery/const.go, tests/disaster-recovery/dr_backwards_compat.go, tests/disaster-recovery/dr_same_version.go, tests/disaster-recovery/dr_suite.go, tests/disaster-recovery/preconditions.go, tests/disaster-recovery/tenant_application_lifecycle.go, were changed! exec: go "install" "-mod=mod" "github.com/onsi/ginkgo/v2/ginkgo" go: downloading github.com/google/pprof v0.0.0-20260115054156-294ebfa9ad83 go: downloading github.com/go-task/slim-sprig/v3 v3.0.0 I0429 14:01:21.459073 19486 install.go:188] cloning 'https://github.com/redhat-appstudio/infra-deployments' with git ref 'refs/heads/main' Enumerating objects: 80110, done. Total 80110 (delta 0), reused 0 (delta 0), pack-reused 80110 (from 1) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. ============================================================================= [2026-04-29 14:01:25] [STEP] Starting Konflux Cluster Bootstrap ============================================================================= [2026-04-29 14:01:25] [INFO] Mode: preview [2026-04-29 14:01:25] [INFO] Options: OBO=disabled, EAAS=disabled [2026-04-29 14:01:25] [INFO] Start time: 2026-04-29 14:01:25 UTC ============================================================================= [2026-04-29 14:01:25] [STEP] Phase 1: Deploying ArgoCD ============================================================================= ============================================================================= [2026-04-29 14:01:25] [STEP] Deploying OpenShift GitOps (ArgoCD) ============================================================================= [2026-04-29 14:01:25] [SUBSTEP] Verifying cluster-admin permissions [2026-04-29 14:01:25] [SUCCESS] User 'cluster-admin' has cluster-admin permissions [2026-04-29 14:01:25] [SUBSTEP] Installing OpenShift GitOps operator subscription clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created subscription.operators.coreos.com/openshift-gitops-operator created [2026-04-29 14:01:26] [SUCCESS] GitOps operator subscription applied [2026-04-29 14:01:26] [SUBSTEP] Waiting for default ArgoCD project to be created [2026-04-29 14:01:26] [WAITING] Default project not yet available (5s/300s) [2026-04-29 14:01:31] [WAITING] Default project not yet available (10s/300s) [2026-04-29 14:01:36] [WAITING] Default project not yet available (15s/300s) [2026-04-29 14:01:42] [WAITING] Default project not yet available (20s/300s) [2026-04-29 14:01:47] [WAITING] Default project not yet available (25s/300s) [2026-04-29 14:01:52] [WAITING] Default project not yet available (30s/300s) [2026-04-29 14:01:57] [WAITING] Default project not yet available (35s/300s) [2026-04-29 14:02:02] [SUCCESS] Default ArgoCD project is available [2026-04-29 14:02:02] [SUBSTEP] Waiting for OpenShift GitOps route to be created [2026-04-29 14:02:02] [SUCCESS] OpenShift GitOps route is available [2026-04-29 14:02:02] [SUBSTEP] Configuring ArgoCD repo server resources and timeout argocd.argoproj.io/openshift-gitops patched [2026-04-29 14:02:03] [SUCCESS] Repo server configured: timeout=5m, cpu=100m, memory=100Mi [2026-04-29 14:02:03] [SUBSTEP] Configuring ArgoCD application controller resources argocd.argoproj.io/openshift-gitops patched [2026-04-29 14:02:03] [SUCCESS] Application controller configured: cpu=4, memory=4Gi [2026-04-29 14:02:03] [SUBSTEP] Switching ArgoCD route to re-encryption TLS argocd.argoproj.io/openshift-gitops patched [2026-04-29 14:02:03] [SUCCESS] Route TLS termination set to 'reencrypt' [2026-04-29 14:02:03] [SUBSTEP] Restarting ArgoCD server after TLS configuration change pod "openshift-gitops-server-6944966b75-bkglt" deleted [2026-04-29 14:02:05] [SUCCESS] ArgoCD server pods deleted for restart [2026-04-29 14:02:05] [SUBSTEP] Granting admin role to authenticated users [2026-04-29 14:02:05] [INFO] Note: This should be updated once proper access policy is in place argocd.argoproj.io/openshift-gitops patched [2026-04-29 14:02:05] [SUCCESS] RBAC policy set: system:authenticated -> role:admin [2026-04-29 14:02:05] [SUBSTEP] Configuring PVC health check (WaitForFirstConsumer workaround) Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) [2026-04-29 14:02:06] [SUCCESS] PVC health customization applied (Pending/Bound = Healthy) [2026-04-29 14:02:06] [SUBSTEP] Enabling Helm support in Kustomize builds argocd.argoproj.io/openshift-gitops patched [2026-04-29 14:02:06] [SUCCESS] Kustomize build options set: --enable-helm [2026-04-29 14:02:06] [SUBSTEP] Configuring ArgoCD to ignore aggregated roles in diff argocd.argoproj.io/openshift-gitops patched [2026-04-29 14:02:06] [SUCCESS] ignoreAggregatedRoles set to true [2026-04-29 14:02:06] [SUBSTEP] Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched [2026-04-29 14:02:06] [SUCCESS] Resource tracking method set to 'annotation' [2026-04-29 14:02:06] [SUBSTEP] Restarting GitOps server deployment deployment.apps/openshift-gitops-server restarted [2026-04-29 14:02:06] [SUCCESS] GitOps server restart initiated [2026-04-29 14:02:06] [INFO] Waiting for rollout to complete... Waiting for deployment "openshift-gitops-server" rollout to finish: 0 out of 1 new replicas have been updated... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... deployment "openshift-gitops-server" successfully rolled out [2026-04-29 14:02:37] [SUCCESS] GitOps server rollout complete ============================================================================= [2026-04-29 14:02:37] [STEP] ArgoCD Access Information ============================================================================= [2026-04-29 14:02:37] [INFO] ArgoCD URL: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com [2026-04-29 14:02:37] [INFO] Authentication: Use 'Login with OpenShift' button (OpenShift credentials) [2026-04-29 14:02:37] [SUBSTEP] Verifying ArgoCD route is accessible [2026-04-29 14:02:57] [WAITING] Waiting for route to respond (5s/120s) [2026-04-29 14:03:02] [SUCCESS] ArgoCD is accessible at https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com [ARGOCD_DEPLOY_JSON] {"status":"success","url":"https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com","namespace":"openshift-gitops","auth_method":"openshift"} ============================================================================= [2026-04-29 14:03:02] [STEP] OpenShift GitOps Deployment Complete ============================================================================= ============================================================================= [2026-04-29 14:03:02] [STEP] Phase 2: Bootstrapping Host Cluster ============================================================================= [2026-04-29 14:03:02] [INFO] Bootstrapping host cluster components [2026-04-29 14:03:02] [INFO] No preview.env file found - using environment variables only [2026-04-29 14:03:02] [SUBSTEP] Configuring Quality Dashboard secrets Setting secrets for Quality Dashboard namespace/quality-dashboard created secret/quality-dashboard-secrets created [2026-04-29 14:03:05] [SUCCESS] Quality Dashboard secrets configured [2026-04-29 14:03:05] [SUBSTEP] Configuring CI Helper App secret Creating secret for CI Helper App namespace/ci-helper-app created secret/ci-helper-app-secrets created [2026-04-29 14:03:10] [SUCCESS] CI Helper App secret configured [2026-04-29 14:03:10] [SUCCESS] Host cluster bootstrap complete ============================================================================= [2026-04-29 14:03:10] [STEP] Phase 3: Bootstrapping Member Cluster ============================================================================= [2026-04-29 14:03:10] [INFO] Bootstrapping member cluster components [2026-04-29 14:03:10] [INFO] No preview.env file found - using environment variables only [2026-04-29 14:03:10] [SUBSTEP] Configuring Pipeline Service secrets Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation namespace/product-kubearchive-logging created Creating DB secret secret/tekton-results-database created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config secret/minio-storage-configuration created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config MinIO config already exists, skipping creation Creating Postgres TLS certs secret/postgresql-tls created configmap/rds-root-crt created [2026-04-29 14:03:12] [SUCCESS] Pipeline Service secrets configured [2026-04-29 14:03:12] [SUBSTEP] Configuring GitHub secrets [2026-04-29 14:03:12] [INFO] GitHub token provided - creating secrets namespace/application-service created Creating a has secret from legacy token secret/has-github-token created [2026-04-29 14:03:13] [SUCCESS] GitHub secrets configured [2026-04-29 14:03:13] [SUBSTEP] Configuring Image Controller secrets [2026-04-29 14:03:13] [INFO] Quay organization: redhat-appstudio-qe Creating a secret with a token for Image Controller namespace/image-controller created secret/quaytoken created [2026-04-29 14:03:14] [SUCCESS] Image Controller secrets configured [2026-04-29 14:03:14] [SUCCESS] Member cluster bootstrap complete ============================================================================= [2026-04-29 14:03:14] [STEP] Phase 4: Bootstrapping Common Components ============================================================================= [2026-04-29 14:03:14] [INFO] Bootstrapping common cluster components [2026-04-29 14:03:14] [INFO] No preview.env file found at /tmp/tmp.dHmAIdSIvq/tmp/infra-deployments/hack/../hack/preview.env - using environment variables only [2026-04-29 14:03:14] [SUBSTEP] Configuring Docker Hub pull secret Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.jsJIrOrLHg secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.jsJIrOrLHg secret/docker-io-pull created [2026-04-29 14:03:15] [SUCCESS] Docker Hub pull secret configured [2026-04-29 14:03:15] [SUBSTEP] Configuring DORA metrics exporter secrets Setting secrets for Dora metrics exporter namespace/dora-metrics created secret/exporters-secret created [2026-04-29 14:03:16] [SUCCESS] DORA metrics exporter secrets configured [2026-04-29 14:03:16] [SUCCESS] Common cluster bootstrap complete ============================================================================= [2026-04-29 14:03:16] [STEP] Phase 5: Mode-Specific Deployment (preview) ============================================================================= [2026-04-29 14:03:16] [INFO] Deploying preview configuration ============================================================================= [2026-04-29 14:03:16] [STEP] Starting Konflux Preview Environment Setup ============================================================================= [2026-04-29 14:03:16] [INFO] Script: /tmp/tmp.dHmAIdSIvq/tmp/infra-deployments/hack/../hack/preview.sh [2026-04-29 14:03:16] [INFO] Options: OBO=false, GRAFANA=false, EAAS=false [2026-04-29 14:03:16] [INFO] Start time: 2026-04-29 14:03:16 UTC ============================================================================= [2026-04-29 14:03:16] [STEP] Cluster Context Information ============================================================================= [2026-04-29 14:03:16] [INFO] OpenShift Version: 4.18.9 [2026-04-29 14:03:16] [INFO] API Server: https://api.kx-849bccb8ec.ajj5.p3.openshiftapps.com:443 [2026-04-29 14:03:16] [INFO] Cluster ID: 89d33736-9972-40c7-891a-539e9d61559d [2026-04-29 14:03:16] [INFO] Cluster Domain: apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com [2026-04-29 14:03:16] [INFO] Total Nodes: 3 [2026-04-29 14:03:17] [INFO] - Master nodes: 0 [2026-04-29 14:03:17] [INFO] - Worker nodes: 3 [2026-04-29 14:03:17] [SUCCESS] Cluster operators: All healthy [CLUSTER_CONTEXT_JSON] {"ocp_version":"4.18.9","api_server":"https://api.kx-849bccb8ec.ajj5.p3.openshiftapps.com:443","cluster_id":"89d33736-9972-40c7-891a-539e9d61559d","cluster_domain":"apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com","total_nodes":3,"master_nodes":0,"worker_nodes":3,"degraded_operators":0} Switched to a new branch 'preview-main-cxkl' [2026-04-29 14:03:17] [SUCCESS] Git environment initialized [2026-04-29 14:03:17] [INFO] - Repository URL: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-04-29 14:03:17] [INFO] - Source branch: main [2026-04-29 14:03:17] [INFO] - Preview branch: preview-main-cxkl [2026-04-29 14:03:17] [INFO] - GitHub org: redhat-appstudio-qe ============================================================================= [2026-04-29 14:03:17] [STEP] Patching ArgoCD application manifests to use fork repository ============================================================================= [2026-04-29 14:03:17] [INFO] Setting repoURL to: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-04-29 14:03:17] [INFO] Setting targetRevision to: preview-main-cxkl [2026-04-29 14:03:17] [SUBSTEP] Patched: application-patch.yaml [2026-04-29 14:03:17] [SUBSTEP] Patched: application-set-patch.yaml [2026-04-29 14:03:17] [SUBSTEP] Patched: application-set-multisrc-src-1-patch.yaml [2026-04-29 14:03:17] [SUCCESS] All ArgoCD patch files updated ============================================================================= [2026-04-29 14:03:17] [STEP] Labeling cluster nodes for Konflux workloads ============================================================================= [2026-04-29 14:03:17] [INFO] Reference: https://github.com/redhat-appstudio/infra-deployments/pull/4415 [2026-04-29 14:03:17] [INFO] Found 3 nodes to label with 'konflux-ci.dev/workload=konflux-tenants' [2026-04-29 14:03:17] [SUBSTEP] Labeling node/ip-10-0-140-223.ec2.internal node/ip-10-0-140-223.ec2.internal labeled [2026-04-29 14:03:17] [SUCCESS] Successfully labeled node/ip-10-0-140-223.ec2.internal [2026-04-29 14:03:17] [SUBSTEP] Labeling node/ip-10-0-157-36.ec2.internal node/ip-10-0-157-36.ec2.internal labeled [2026-04-29 14:03:18] [SUCCESS] Successfully labeled node/ip-10-0-157-36.ec2.internal [2026-04-29 14:03:18] [SUBSTEP] Labeling node/ip-10-0-160-96.ec2.internal node/ip-10-0-160-96.ec2.internal labeled [2026-04-29 14:03:18] [SUCCESS] Successfully labeled node/ip-10-0-160-96.ec2.internal [2026-04-29 14:03:18] [SUBSTEP] Verifying labels on all nodes... [2026-04-29 14:03:18] [SUCCESS] All 3 nodes labeled and verified successfully ============================================================================= [2026-04-29 14:03:18] [STEP] Checking OCP version for Kueue compatibility ============================================================================= [2026-04-29 14:03:18] [INFO] Detected OpenShift Container Platform version: 4.18.9 (minor: 18) [2026-04-29 14:03:18] [SUCCESS] OCP version 4.18.9 meets Kueue requirements - Kueue will be deployed ============================================================================= [2026-04-29 14:03:18] [STEP] Configuring GitHub organization ============================================================================= [2026-04-29 14:03:18] [INFO] Setting GitHub org to: redhat-appstudio-qe [2026-04-29 14:03:18] [INFO] Configuring GitHub organization for Application Service (HAS) [2026-04-29 14:03:18] [INFO] - Target org: redhat-appstudio-qe [2026-04-29 14:03:18] [INFO] - Config file: /tmp/tmp.dHmAIdSIvq/tmp/infra-deployments/hack/../components/has/base/kustomization.yaml [2026-04-29 14:03:18] [SUCCESS] GitHub organization set to 'redhat-appstudio-qe' [2026-04-29 14:03:18] [SUCCESS] Verified: Configuration updated correctly [2026-04-29 14:03:18] [SUCCESS] GitHub organization configured ============================================================================= [2026-04-29 14:03:18] [STEP] Configuring Rekor server hostname ============================================================================= [2026-04-29 14:03:18] [INFO] Cluster domain: apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com [2026-04-29 14:03:18] [INFO] Rekor server hostname: rekor.apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com [2026-04-29 14:03:18] [SUCCESS] Rekor server hostname configured ============================================================================= [2026-04-29 14:03:18] [STEP] Applying service image overrides from environment variables ============================================================================= [2026-04-29 14:03:18] [INFO] No service image overrides configured - using default images ============================================================================= [2026-04-29 14:03:18] [STEP] Committing and pushing preview changes ============================================================================= [preview-main-cxkl 88d6b3ede] Preview mode, do not merge into main 8 files changed, 15 insertions(+), 19 deletions(-) remote: remote: Create a pull request for 'preview-main-cxkl' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-cxkl remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-cxkl -> preview-main-cxkl branch 'preview-main-cxkl' set up to track 'qe/preview-main-cxkl'. [2026-04-29 14:03:19] [SUCCESS] Preview changes committed and pushed to qe/preview-main-cxkl ============================================================================= [2026-04-29 14:03:19] [STEP] Deploying ArgoCD applications ============================================================================= [2026-04-29 14:03:19] [SUBSTEP] Applying root Application from: /tmp/tmp.dHmAIdSIvq/tmp/infra-deployments/hack/../argo-cd-apps/app-of-app-sets/development application.argoproj.io/all-application-sets created [2026-04-29 14:03:20] [SUCCESS] Root Application 'all-application-sets' created [2026-04-29 14:03:20] [SUBSTEP] Waiting for 'all-application-sets' to become Healthy and Synced [2026-04-29 14:03:20] [WAITING] Root application status: ' ' (target: 'Healthy Synced') - 5s elapsed [2026-04-29 14:03:25] [WAITING] Root application status: ' ' (target: 'Healthy Synced') - 10s elapsed [2026-04-29 14:03:30] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 15s elapsed [2026-04-29 14:03:36] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 20s elapsed [2026-04-29 14:03:41] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 25s elapsed [2026-04-29 14:03:46] [WAITING] Root application status: 'Healthy OutOfSync' (target: 'Healthy Synced') - 30s elapsed [2026-04-29 14:03:51] [SUCCESS] Root application 'all-application-sets' is Healthy and Synced [2026-04-29 14:03:51] [SUBSTEP] Triggering hard refresh on all ArgoCD applications [2026-04-29 14:03:51] [INFO] Found 43 applications to refresh application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/monitoring-registry-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/konflux-info-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/dora-metrics-in-cluster-local patched application.argoproj.io/disaster-recovery-in-cluster-local patched application.argoproj.io/has-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/image-rbac-proxy-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/backup-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/monitoring-workload-custom-kube-state-metrics-in-cluster-local patched application.argoproj.io/monitoring-cardinality-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/smee-client-in-cluster-local patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched [2026-04-29 14:03:58] [SUCCESS] Hard refresh triggered on all 43 applications [2026-04-29 14:03:58] [SUBSTEP] Waiting for refresh operations to complete [2026-04-29 14:03:58] [PROGRESS] Refresh: 0/43 complete | 43 still refreshing (5s elapsed) [2026-04-29 14:04:04] [PROGRESS] Refresh: 0/43 complete | 43 still refreshing (10s elapsed) [2026-04-29 14:04:09] [PROGRESS] Refresh: 5/43 complete | 38 still refreshing (15s elapsed) [2026-04-29 14:04:14] [PROGRESS] Refresh: 19/43 complete | 24 still refreshing (20s elapsed) [2026-04-29 14:04:19] [PROGRESS] Refresh: 23/43 complete | 20 still refreshing (25s elapsed) [2026-04-29 14:04:25] [PROGRESS] Refresh: 25/43 complete | 18 still refreshing (30s elapsed) [2026-04-29 14:04:30] [PROGRESS] Refresh: 40/43 complete | 3 still refreshing (35s elapsed) [2026-04-29 14:04:35] [PROGRESS] Refresh: 40/43 complete | 3 still refreshing (40s elapsed) [2026-04-29 14:04:41] [PROGRESS] Refresh: 40/43 complete | 3 still refreshing (45s elapsed) [2026-04-29 14:04:46] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (50s elapsed) [2026-04-29 14:04:51] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (55s elapsed) [2026-04-29 14:04:57] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (60s elapsed) [2026-04-29 14:05:02] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (65s elapsed) [2026-04-29 14:05:07] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (70s elapsed) [2026-04-29 14:05:13] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (75s elapsed) [2026-04-29 14:05:18] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (80s elapsed) [2026-04-29 14:05:23] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (85s elapsed) [2026-04-29 14:05:29] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (90s elapsed) [2026-04-29 14:05:34] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (95s elapsed) [2026-04-29 14:05:39] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (100s elapsed) [2026-04-29 14:05:45] [PROGRESS] Refresh: 41/43 complete | 2 still refreshing (105s elapsed) [2026-04-29 14:05:50] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (110s elapsed) [2026-04-29 14:05:56] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (115s elapsed) [2026-04-29 14:06:01] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (120s elapsed) [2026-04-29 14:06:06] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (125s elapsed) [2026-04-29 14:06:12] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (130s elapsed) [2026-04-29 14:06:17] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (135s elapsed) [2026-04-29 14:06:22] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (140s elapsed) [2026-04-29 14:06:28] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (145s elapsed) [2026-04-29 14:06:33] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (150s elapsed) [2026-04-29 14:06:39] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (155s elapsed) [2026-04-29 14:06:44] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (160s elapsed) [2026-04-29 14:06:50] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (165s elapsed) [2026-04-29 14:06:55] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (170s elapsed) [2026-04-29 14:07:00] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (175s elapsed) [2026-04-29 14:07:06] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (180s elapsed) [2026-04-29 14:07:11] [PROGRESS] Refresh: 42/43 complete | 1 still refreshing (185s elapsed) [2026-04-29 14:07:16] [SUCCESS] All 43 applications refreshed ============================================================================= [2026-04-29 14:07:16] [STEP] Waiting for all ArgoCD applications to sync and become healthy ============================================================================= [2026-04-29 14:07:16] [INFO] Timeout: 2700 seconds (45 minutes) [2026-04-29 14:07:17] [PROGRESS] Applications: 18/44 ready | 26 pending (0m 0s elapsed) [2026-04-29 14:07:17] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-info-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,mintmaker-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,release-in-cluster-local,squid-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:07:17] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:07:27] [PROGRESS] Applications: 18/44 ready | 26 pending (0m 11s elapsed) [2026-04-29 14:07:27] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-info-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,mintmaker-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,release-in-cluster-local,squid-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:07:27] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:07:37] [PROGRESS] Applications: 18/44 ready | 26 pending (0m 21s elapsed) [2026-04-29 14:07:37] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-info-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,mintmaker-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,release-in-cluster-local,squid-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:07:37] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:07:47] [PROGRESS] Applications: 19/44 ready | 25 pending (0m 31s elapsed) [2026-04-29 14:07:47] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,mintmaker-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,release-in-cluster-local,squid-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:07:47] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:07:57] [PROGRESS] Applications: 18/44 ready | 26 pending (0m 41s elapsed) [2026-04-29 14:07:57] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,mintmaker-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,release-in-cluster-local,squid-in-cluster-local,tracing-workload-tracing-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:07:57] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:08:08] [PROGRESS] Applications: 19/44 ready | 25 pending (0m 51s elapsed) [2026-04-29 14:08:08] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,mintmaker-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,release-in-cluster-local,squid-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:08:08] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:08:18] [PROGRESS] Applications: 21/44 ready | 23 pending (1m 2s elapsed) [2026-04-29 14:08:18] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,squid-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:08:18] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:08:28] [PROGRESS] Applications: 22/44 ready | 22 pending (1m 12s elapsed) [2026-04-29 14:08:28] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:08:28] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:08:38] [PROGRESS] Applications: 23/44 ready | 21 pending (1m 22s elapsed) [2026-04-29 14:08:38] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:08:38] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:08:48] [PROGRESS] Applications: 23/44 ready | 21 pending (1m 32s elapsed) [2026-04-29 14:08:48] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:08:48] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:08:59] [PROGRESS] Applications: 22/44 ready | 22 pending (1m 42s elapsed) [2026-04-29 14:08:59] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:08:59] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:09:09] [PROGRESS] Applications: 22/44 ready | 22 pending (1m 53s elapsed) [2026-04-29 14:09:09] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:09:09] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:09:19] [PROGRESS] Applications: 22/44 ready | 22 pending (2m 3s elapsed) [2026-04-29 14:09:19] [INFO] Pending: application-api-in-cluster-local,build-service-in-cluster-local,crossplane-control-plane-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,has-in-cluster-local,image-controller-in-cluster-local,image-rbac-proxy-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,konflux-rbac-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,monitoring-registry-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:09:19] [SUBSTEP] Detailed status of pending applications: [2026-04-29 14:09:19] [INFO] ├─ App: application-api-in-cluster-local [2026-04-29 14:09:19] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:19] [INFO] │ ├─ Health Status: Missing [2026-04-29 14:09:19] [INFO] │ ├─ Out-of-sync resources: 11 [2026-04-29 14:09:19] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:19] [WARN] │ │ └─ CustomResourceDefinition/applications.appstudio.redhat.com: Missing [2026-04-29 14:09:19] [WARN] │ │ └─ CustomResourceDefinition/componentdetectionqueries.appstudio.redhat.com: Missing [2026-04-29 14:09:19] [WARN] │ │ └─ CustomResourceDefinition/components.appstudio.redhat.com: Missing [2026-04-29 14:09:19] [INFO] │ └─ Message: No message [2026-04-29 14:09:19] [INFO] ├─ App: build-service-in-cluster-local [2026-04-29 14:09:19] [INFO] │ ├─ Sync Status: Synced [2026-04-29 14:09:19] [INFO] │ ├─ Health Status: Progressing [2026-04-29 14:09:19] [INFO] │ └─ Message: No message [2026-04-29 14:09:20] [INFO] ├─ App: crossplane-control-plane-in-cluster-local [2026-04-29 14:09:20] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:20] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:09:20] [INFO] │ ├─ Out-of-sync resources: 2 [2026-04-29 14:09:20] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:20] [WARN] │ │ └─ ClusterRole/namespace-claim-cleaner: Missing [2026-04-29 14:09:20] [WARN] │ │ └─ ClusterRole/provider-kubernetes-extra: Missing [2026-04-29 14:09:20] [INFO] │ └─ Message: No message [2026-04-29 14:09:20] [INFO] ├─ App: disaster-recovery-in-cluster-local [2026-04-29 14:09:20] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:20] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:09:20] [INFO] │ ├─ Out-of-sync resources: 11 [2026-04-29 14:09:20] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:20] [WARN] │ │ └─ Namespace/konflux-disaster-recovery: Missing [2026-04-29 14:09:20] [WARN] │ │ └─ ServiceAccount/cron-trigger: Missing [2026-04-29 14:09:20] [WARN] │ │ └─ CronJob/run-disaster-recovery-pipelinerun: Missing [2026-04-29 14:09:20] [INFO] │ └─ Message: No message [2026-04-29 14:09:20] [INFO] ├─ App: enterprise-contract-in-cluster-local [2026-04-29 14:09:20] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:20] [INFO] │ ├─ Health Status: Missing [2026-04-29 14:09:20] [INFO] │ ├─ Out-of-sync resources: 4 [2026-04-29 14:09:20] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:20] [WARN] │ │ └─ CustomResourceDefinition/enterprisecontractpolicies.appstudio.redhat.com: Missing [2026-04-29 14:09:20] [WARN] │ │ └─ ClusterRole/enterprisecontract-configmap-viewer-role: Missing [2026-04-29 14:09:20] [WARN] │ │ └─ ClusterRole/enterprisecontractpolicy-editor-role: Missing [2026-04-29 14:09:20] [INFO] │ └─ Message: No message [2026-04-29 14:09:20] [INFO] ├─ App: has-in-cluster-local [2026-04-29 14:09:20] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:20] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:09:20] [INFO] │ ├─ Out-of-sync resources: 12 [2026-04-29 14:09:20] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:20] [WARN] │ │ └─ ClusterRole/application-service-application-editor-role: Missing [2026-04-29 14:09:20] [WARN] │ │ └─ ClusterRole/application-service-application-viewer-role: Missing [2026-04-29 14:09:20] [WARN] │ │ └─ ClusterRole/application-service-component-editor-role: Missing [2026-04-29 14:09:20] [INFO] │ └─ Message: No message [2026-04-29 14:09:21] [INFO] ├─ App: image-controller-in-cluster-local [2026-04-29 14:09:21] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:21] [INFO] │ ├─ Health Status: Missing [2026-04-29 14:09:21] [INFO] │ ├─ Out-of-sync resources: 7 [2026-04-29 14:09:21] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:21] [WARN] │ │ └─ CustomResourceDefinition/imagerepositories.appstudio.redhat.com: Missing [2026-04-29 14:09:21] [WARN] │ │ └─ ClusterRole/image-controller-imagerepository-editor-role: Missing [2026-04-29 14:09:21] [WARN] │ │ └─ ClusterRole/image-controller-imagerepository-viewer-role: Missing [2026-04-29 14:09:21] [INFO] │ └─ Message: No message [2026-04-29 14:09:21] [INFO] ├─ App: image-rbac-proxy-in-cluster-local [2026-04-29 14:09:21] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:21] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:09:21] [INFO] │ ├─ Out-of-sync resources: 2 [2026-04-29 14:09:21] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:21] [WARN] │ │ └─ ClusterRole/image-proxy-dex: Missing [2026-04-29 14:09:21] [WARN] │ │ └─ ClusterRole/image-rbac-proxy: Missing [2026-04-29 14:09:21] [INFO] │ └─ Message: No message [2026-04-29 14:09:21] [INFO] ├─ App: integration-in-cluster-local [2026-04-29 14:09:21] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:21] [INFO] │ ├─ Health Status: Missing [2026-04-29 14:09:21] [INFO] │ ├─ Out-of-sync resources: 19 [2026-04-29 14:09:21] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:21] [WARN] │ │ └─ CustomResourceDefinition/componentgroups.appstudio.redhat.com: Missing [2026-04-29 14:09:21] [WARN] │ │ └─ CustomResourceDefinition/integrationtestscenarios.appstudio.redhat.com: Missing [2026-04-29 14:09:21] [WARN] │ │ └─ ClusterRole/crd-manager-for-integration: Missing [2026-04-29 14:09:21] [INFO] │ └─ Message: No message [2026-04-29 14:09:21] [INFO] ├─ App: internal-services-in-cluster-local [2026-04-29 14:09:21] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:21] [INFO] │ ├─ Health Status: Missing [2026-04-29 14:09:21] [INFO] │ ├─ Out-of-sync resources: 3 [2026-04-29 14:09:21] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:21] [WARN] │ │ └─ CustomResourceDefinition/internalrequests.appstudio.redhat.com: Missing [2026-04-29 14:09:21] [WARN] │ │ └─ CustomResourceDefinition/internalservicesconfigs.appstudio.redhat.com: Missing [2026-04-29 14:09:21] [WARN] │ │ └─ ClusterRole/internal-service-request-role: Missing [2026-04-29 14:09:21] [INFO] │ └─ Message: No message [2026-04-29 14:09:22] [INFO] ├─ App: knative-eventing-in-cluster-local [2026-04-29 14:09:22] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:22] [INFO] │ ├─ Health Status: Missing [2026-04-29 14:09:22] [INFO] │ ├─ Out-of-sync resources: 54 [2026-04-29 14:09:22] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:22] [WARN] │ │ └─ CustomResourceDefinition/apiserversources.sources.knative.dev: Missing [2026-04-29 14:09:22] [WARN] │ │ └─ CustomResourceDefinition/brokers.eventing.knative.dev: Missing [2026-04-29 14:09:22] [WARN] │ │ └─ CustomResourceDefinition/channels.messaging.knative.dev: Missing [2026-04-29 14:09:22] [INFO] │ └─ Message: No message [2026-04-29 14:09:22] [INFO] ├─ App: konflux-kite-in-cluster-local [2026-04-29 14:09:22] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:22] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:09:22] [INFO] │ ├─ Out-of-sync resources: 1 [2026-04-29 14:09:22] [INFO] │ └─ Message: No message [2026-04-29 14:09:22] [INFO] ├─ App: konflux-rbac-in-cluster-local [2026-04-29 14:09:22] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:22] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:09:22] [INFO] │ ├─ Out-of-sync resources: 2 [2026-04-29 14:09:22] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:22] [WARN] │ │ └─ ClusterRole/appstudio-pipelines-runner: Missing [2026-04-29 14:09:22] [WARN] │ │ └─ ClusterRole/konflux-integration-runner: Missing [2026-04-29 14:09:22] [INFO] │ └─ Message: No message [2026-04-29 14:09:22] [INFO] ├─ App: kubearchive-in-cluster-local [2026-04-29 14:09:22] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:22] [INFO] │ ├─ Health Status: Missing [2026-04-29 14:09:22] [INFO] │ ├─ Out-of-sync resources: 18 [2026-04-29 14:09:22] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:22] [WARN] │ │ └─ Secret/kubearchive-logging: Missing [2026-04-29 14:09:22] [WARN] │ │ └─ Secret/metrics-reader: Missing [2026-04-29 14:09:22] [WARN] │ │ └─ CustomResourceDefinition/clusterkubearchiveconfigs.kubearchive.org: Missing [2026-04-29 14:09:22] [INFO] │ └─ Message: No message [2026-04-29 14:09:23] [INFO] ├─ App: kueue-in-cluster-local [2026-04-29 14:09:23] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:23] [INFO] │ ├─ Health Status: Progressing [2026-04-29 14:09:23] [INFO] │ ├─ Out-of-sync resources: 12 [2026-04-29 14:09:23] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:23] [WARN] │ │ └─ Secret/metrics-reader: Missing [2026-04-29 14:09:23] [WARN] │ │ └─ ServiceMonitor/tekton-kueue-controller: Missing [2026-04-29 14:09:23] [WARN] │ │ └─ ServiceMonitor/tekton-kueue-webhook: Missing [2026-04-29 14:09:23] [INFO] │ └─ Message: No message [2026-04-29 14:09:23] [INFO] ├─ App: kyverno-in-cluster-local [2026-04-29 14:09:23] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:23] [INFO] │ ├─ Health Status: Missing [2026-04-29 14:09:23] [INFO] │ ├─ Out-of-sync resources: 31 [2026-04-29 14:09:23] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:23] [WARN] │ │ └─ CustomResourceDefinition/cleanuppolicies.kyverno.io: Missing [2026-04-29 14:09:23] [WARN] │ │ └─ CustomResourceDefinition/clustercleanuppolicies.kyverno.io: Missing [2026-04-29 14:09:23] [WARN] │ │ └─ CustomResourceDefinition/clusterephemeralreports.reports.kyverno.io: Missing [2026-04-29 14:09:23] [INFO] │ └─ Message: No message [2026-04-29 14:09:23] [INFO] ├─ App: monitoring-registry-in-cluster-local [2026-04-29 14:09:23] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:23] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:09:23] [INFO] │ ├─ Out-of-sync resources: 2 [2026-04-29 14:09:23] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:23] [WARN] │ │ └─ ClusterRole/kube-rbac-proxy-registry: Missing [2026-04-29 14:09:23] [WARN] │ │ └─ ClusterRole/registry-exporter-role-metrics-reader: Missing [2026-04-29 14:09:23] [INFO] │ └─ Message: No message [2026-04-29 14:09:23] [INFO] ├─ App: multi-platform-controller-in-cluster-local [2026-04-29 14:09:23] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:23] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:09:23] [INFO] │ ├─ Out-of-sync resources: 4 [2026-04-29 14:09:23] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:23] [WARN] │ │ └─ Secret/metrics-reader: Missing [2026-04-29 14:09:23] [WARN] │ │ └─ ClusterRole/multi-platform-controller-manager-role: Missing [2026-04-29 14:09:23] [WARN] │ │ └─ ClusterRole/multi-platform-controller-metrics-auth-role: Missing [2026-04-29 14:09:23] [INFO] │ └─ Message: No message [2026-04-29 14:09:24] [INFO] ├─ App: pipeline-service-in-cluster-local [2026-04-29 14:09:24] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:24] [INFO] │ ├─ Health Status: Missing [2026-04-29 14:09:24] [INFO] │ ├─ Out-of-sync resources: 23 [2026-04-29 14:09:24] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:24] [WARN] │ │ └─ Service/tekton-results-watcher: Missing [2026-04-29 14:09:24] [WARN] │ │ └─ CustomResourceDefinition/miniojobs.job.min.io: Missing [2026-04-29 14:09:24] [WARN] │ │ └─ CustomResourceDefinition/policybindings.sts.min.io: Missing [2026-04-29 14:09:24] [INFO] │ └─ Message: No message [2026-04-29 14:09:24] [INFO] ├─ App: policies-in-cluster-local [2026-04-29 14:09:24] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:24] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:09:24] [INFO] │ ├─ Out-of-sync resources: 40 [2026-04-29 14:09:24] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:24] [WARN] │ │ └─ ValidatingAdmissionPolicy/deny-serviceaccount-token-secrets.konflux-ci.dev: Missing [2026-04-29 14:09:24] [WARN] │ │ └─ ValidatingAdmissionPolicy/limit-pod-serviceaccount-token-expiration.konflux-ci.dev: Missing [2026-04-29 14:09:24] [WARN] │ │ └─ ValidatingAdmissionPolicy/limit-serviceaccount-tokenrequest-expiration.konflux-ci.dev: Missing [2026-04-29 14:09:24] [INFO] │ └─ Message: No message [2026-04-29 14:09:24] [INFO] ├─ App: trust-manager-in-cluster-local [2026-04-29 14:09:24] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:24] [INFO] │ ├─ Health Status: Missing [2026-04-29 14:09:24] [INFO] │ ├─ Out-of-sync resources: 2 [2026-04-29 14:09:24] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:24] [WARN] │ │ └─ CustomResourceDefinition/bundles.trust.cert-manager.io: Missing [2026-04-29 14:09:24] [WARN] │ │ └─ ClusterRole/trust-manager: Missing [2026-04-29 14:09:24] [INFO] │ └─ Message: No message [2026-04-29 14:09:25] [INFO] ├─ App: vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:09:25] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:09:25] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:09:25] [INFO] │ ├─ Out-of-sync resources: 3 [2026-04-29 14:09:25] [WARN] │ ├─ Degraded/Missing resources: [2026-04-29 14:09:25] [WARN] │ │ └─ ClusterRole/grafana-clusterrole: Missing [2026-04-29 14:09:25] [WARN] │ │ └─ ClusterRole/loki-clusterrole: Missing [2026-04-29 14:09:25] [WARN] │ │ └─ ClusterRole/vector: Missing [2026-04-29 14:09:25] [WARN] │ └─ Conditions: [2026-04-29 14:09:25] [WARN] │ └─ [RepeatedResourceWarning] Resource /ServiceAccount/product-kubearchive-logging/minio-sa appeared 2 times among application resources. [2026-04-29 14:09:25] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:09:35] [PROGRESS] Applications: 29/44 ready | 15 pending (2m 19s elapsed) [2026-04-29 14:09:35] [INFO] Pending: application-api-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,image-controller-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,multi-platform-controller-in-cluster-local,pipeline-service-in-cluster-local,policies-in-cluster-local,trust-manager-in-cluster-local [2026-04-29 14:09:35] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:09:45] [PROGRESS] Applications: 31/44 ready | 13 pending (2m 29s elapsed) [2026-04-29 14:09:45] [INFO] Pending: application-api-in-cluster-local,disaster-recovery-in-cluster-local,enterprise-contract-in-cluster-local,image-controller-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,pipeline-service-in-cluster-local,trust-manager-in-cluster-local [2026-04-29 14:09:45] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:09:55] [PROGRESS] Applications: 31/44 ready | 13 pending (2m 39s elapsed) [2026-04-29 14:09:55] [INFO] Pending: application-api-in-cluster-local,enterprise-contract-in-cluster-local,image-controller-in-cluster-local,integration-in-cluster-local,internal-services-in-cluster-local,knative-eventing-in-cluster-local,konflux-kite-in-cluster-local,kubearchive-in-cluster-local,kueue-in-cluster-local,kyverno-in-cluster-local,pipeline-service-in-cluster-local,trust-manager-in-cluster-local,vector-kubearchive-log-collector-in-cluster-local [2026-04-29 14:09:55] [WARN] Found applications in Unknown state (not Progressing), investigating... [2026-04-29 14:09:55] [ERROR] Application 'vector-kubearchive-log-collector-in-cluster-local' is in Unknown state without 'context deadline exceeded' Switched to branch 'main' Your branch is up to date with 'upstream/main'. I0429 14:09:56.107214 19486 common.go:278] got an error: exit status 141 - will retry in 10s [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 135 [running]: > runtime/debug.Stack() > /usr/lib/golang/src/runtime/debug/stack.go:26 +0x5e > sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot() > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/log/log.go:60 +0xcd > sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0xc000975c40, {0x37ae6c8, 0x14}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/log/deleg.go:147 +0x3e > github.com/go-logr/logr.Logger.WithName({{0x40329a0, 0xc000975c40}, 0x0}, {0x37ae6c8?, 0x0?}) > /opt/app-root/src/go/pkg/mod/github.com/go-logr/logr@v1.4.3/logr.go:345 +0x36 > sigs.k8s.io/controller-runtime/pkg/client.newClient(0x1?, {0x0, 0xc000618070, {0x0, 0x0}, 0x0, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/client/client.go:118 +0xdb > sigs.k8s.io/controller-runtime/pkg/client.New(0xc000de4008?, {0x0, 0xc000618070, {0x0, 0x0}, 0x0, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/client/client.go:98 +0x4d > github.com/konflux-ci/e2e-tests/pkg/clients/kubernetes.NewAdminKubernetesClient() > /tmp/tmp.dHmAIdSIvq/pkg/clients/kubernetes/client.go:159 +0x8f > github.com/konflux-ci/e2e-tests/magefiles/installation.NewAppStudioInstallController() > /tmp/tmp.dHmAIdSIvq/magefiles/installation/install.go:98 +0x31 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.InstallKonflux() > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/repos/common.go:262 +0x13 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.retry(0x3b6d308, 0x2, 0x2540be400) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/repos/common.go:281 +0xf9 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.init.func7(0x3fede40?) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/repos/common.go:355 +0xae > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.ActionFunc.Execute(0xc?, 0x378593a?) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/types.go:279 +0x19 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Apply(...) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/types.go:315 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x619ffe0, 0xc0006dd908) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/types.go:348 +0xb3 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x6197dc0?, 0xc001387bd8?, 0x24114f9?}, 0xc0006dd908) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x61a0100, 0xc0006dd908) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/types.go:340 +0x2b > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x61a1d80?, 0xc000f5dc90?, 0x42f025?}, 0xc0006dd908) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).runLoadedCatalog(0x61d89c8, {0xc000e3c288?, 0xc000f5de60?, 0x47?}, 0xc0006dd908) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/types.go:129 +0x11f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).RunRulesOfCategory(0x61d89c8, {0x377f882, 0x2}, 0xc0006dd908) > /tmp/tmp.dHmAIdSIvq/magefiles/rulesengine/types.go:121 +0x1b4 > main.CI.TestE2E({}) > /tmp/tmp.dHmAIdSIvq/magefiles/magefile.go:331 +0x18a > main.main.func20({0xc00064b418?, 0x1eb57ce?}) > /tmp/tmp.dHmAIdSIvq/magefiles/mage_output_file.go:888 +0xf > main.main.func12.1() > /tmp/tmp.dHmAIdSIvq/magefiles/mage_output_file.go:306 +0x5b > created by main.main.func12 in goroutine 1 > /tmp/tmp.dHmAIdSIvq/magefiles/mage_output_file.go:301 +0xbe W0429 14:10:06.108254 19486 install.go:178] folder /tmp/tmp.dHmAIdSIvq/tmp/infra-deployments already exists... removing I0429 14:10:06.269342 19486 install.go:188] cloning 'https://github.com/redhat-appstudio/infra-deployments' with git ref 'refs/heads/main' Enumerating objects: 80133, done. Counting objects: 5% (1/19) Counting objects: 10% (2/19) Counting objects: 15% (3/19) Counting objects: 21% (4/19) Counting objects: 26% (5/19) Counting objects: 31% (6/19) Counting objects: 36% (7/19) Counting objects: 42% (8/19) Counting objects: 47% (9/19) Counting objects: 52% (10/19) Counting objects: 57% (11/19) Counting objects: 63% (12/19) Counting objects: 68% (13/19) Counting objects: 73% (14/19) Counting objects: 78% (15/19) Counting objects: 84% (16/19) Counting objects: 89% (17/19) Counting objects: 94% (18/19) Counting objects: 100% (19/19) Counting objects: 100% (19/19), done. Compressing objects: 5% (1/19) Compressing objects: 10% (2/19) Compressing objects: 15% (3/19) Compressing objects: 21% (4/19) Compressing objects: 26% (5/19) Compressing objects: 31% (6/19) Compressing objects: 36% (7/19) Compressing objects: 42% (8/19) Compressing objects: 47% (9/19) Compressing objects: 52% (10/19) Compressing objects: 57% (11/19) Compressing objects: 63% (12/19) Compressing objects: 68% (13/19) Compressing objects: 73% (14/19) Compressing objects: 78% (15/19) Compressing objects: 84% (16/19) Compressing objects: 89% (17/19) Compressing objects: 94% (18/19) Compressing objects: 100% (19/19) Compressing objects: 100% (19/19), done. Total 80133 (delta 6), reused 0 (delta 0), pack-reused 80114 (from 1) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. ============================================================================= [2026-04-29 14:10:11] [STEP] Starting Konflux Cluster Bootstrap ============================================================================= [2026-04-29 14:10:11] [INFO] Mode: preview [2026-04-29 14:10:11] [INFO] Options: OBO=disabled, EAAS=disabled [2026-04-29 14:10:11] [INFO] Start time: 2026-04-29 14:10:11 UTC ============================================================================= [2026-04-29 14:10:11] [STEP] Phase 1: Deploying ArgoCD ============================================================================= ============================================================================= [2026-04-29 14:10:11] [STEP] Deploying OpenShift GitOps (ArgoCD) ============================================================================= [2026-04-29 14:10:11] [SUBSTEP] Verifying cluster-admin permissions [2026-04-29 14:10:11] [SUCCESS] User 'cluster-admin' has cluster-admin permissions [2026-04-29 14:10:11] [SUBSTEP] Installing OpenShift GitOps operator subscription clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller unchanged clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server unchanged clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller unchanged clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server unchanged subscription.operators.coreos.com/openshift-gitops-operator unchanged [2026-04-29 14:10:12] [SUCCESS] GitOps operator subscription applied [2026-04-29 14:10:12] [SUBSTEP] Waiting for default ArgoCD project to be created [2026-04-29 14:10:12] [SUCCESS] Default ArgoCD project is available [2026-04-29 14:10:12] [SUBSTEP] Waiting for OpenShift GitOps route to be created [2026-04-29 14:10:12] [SUCCESS] OpenShift GitOps route is available [2026-04-29 14:10:12] [SUBSTEP] Configuring ArgoCD repo server resources and timeout argocd.argoproj.io/openshift-gitops patched (no change) [2026-04-29 14:10:12] [SUCCESS] Repo server configured: timeout=5m, cpu=100m, memory=100Mi [2026-04-29 14:10:12] [SUBSTEP] Configuring ArgoCD application controller resources argocd.argoproj.io/openshift-gitops patched (no change) [2026-04-29 14:10:12] [SUCCESS] Application controller configured: cpu=4, memory=4Gi [2026-04-29 14:10:12] [SUBSTEP] Switching ArgoCD route to re-encryption TLS argocd.argoproj.io/openshift-gitops patched (no change) [2026-04-29 14:10:13] [SUCCESS] Route TLS termination set to 'reencrypt' [2026-04-29 14:10:13] [SUBSTEP] Restarting ArgoCD server after TLS configuration change pod "openshift-gitops-server-678c84549b-594ps" deleted [2026-04-29 14:10:13] [SUCCESS] ArgoCD server pods deleted for restart [2026-04-29 14:10:13] [SUBSTEP] Granting admin role to authenticated users [2026-04-29 14:10:13] [INFO] Note: This should be updated once proper access policy is in place argocd.argoproj.io/openshift-gitops patched (no change) [2026-04-29 14:10:14] [SUCCESS] RBAC policy set: system:authenticated -> role:admin [2026-04-29 14:10:14] [SUBSTEP] Configuring PVC health check (WaitForFirstConsumer workaround) Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) [2026-04-29 14:10:14] [SUCCESS] PVC health customization applied (Pending/Bound = Healthy) [2026-04-29 14:10:14] [SUBSTEP] Enabling Helm support in Kustomize builds argocd.argoproj.io/openshift-gitops patched (no change) [2026-04-29 14:10:14] [SUCCESS] Kustomize build options set: --enable-helm [2026-04-29 14:10:14] [SUBSTEP] Configuring ArgoCD to ignore aggregated roles in diff argocd.argoproj.io/openshift-gitops patched (no change) [2026-04-29 14:10:14] [SUCCESS] ignoreAggregatedRoles set to true [2026-04-29 14:10:14] [SUBSTEP] Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched (no change) [2026-04-29 14:10:14] [SUCCESS] Resource tracking method set to 'annotation' [2026-04-29 14:10:14] [SUBSTEP] Restarting GitOps server deployment deployment.apps/openshift-gitops-server restarted [2026-04-29 14:10:14] [SUCCESS] GitOps server restart initiated [2026-04-29 14:10:14] [INFO] Waiting for rollout to complete... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "openshift-gitops-server" rollout to finish: 1 old replicas are pending termination... deployment "openshift-gitops-server" successfully rolled out [2026-04-29 14:10:18] [SUCCESS] GitOps server rollout complete ============================================================================= [2026-04-29 14:10:18] [STEP] ArgoCD Access Information ============================================================================= [2026-04-29 14:10:19] [INFO] ArgoCD URL: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com [2026-04-29 14:10:19] [INFO] Authentication: Use 'Login with OpenShift' button (OpenShift credentials) [2026-04-29 14:10:19] [SUBSTEP] Verifying ArgoCD route is accessible [2026-04-29 14:10:19] [SUCCESS] ArgoCD is accessible at https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com [ARGOCD_DEPLOY_JSON] {"status":"success","url":"https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com","namespace":"openshift-gitops","auth_method":"openshift"} ============================================================================= [2026-04-29 14:10:19] [STEP] OpenShift GitOps Deployment Complete ============================================================================= ============================================================================= [2026-04-29 14:10:19] [STEP] Phase 2: Bootstrapping Host Cluster ============================================================================= [2026-04-29 14:10:19] [INFO] Bootstrapping host cluster components [2026-04-29 14:10:19] [INFO] No preview.env file found - using environment variables only [2026-04-29 14:10:19] [SUBSTEP] Configuring Quality Dashboard secrets Setting secrets for Quality Dashboard namespace/quality-dashboard configured [2026-04-29 14:10:20] [SUCCESS] Quality Dashboard secrets configured [2026-04-29 14:10:20] [SUBSTEP] Configuring CI Helper App secret Creating secret for CI Helper App namespace/ci-helper-app configured [2026-04-29 14:10:20] [SUCCESS] CI Helper App secret configured [2026-04-29 14:10:20] [SUCCESS] Host cluster bootstrap complete ============================================================================= [2026-04-29 14:10:20] [STEP] Phase 3: Bootstrapping Member Cluster ============================================================================= [2026-04-29 14:10:20] [INFO] Bootstrapping member cluster components [2026-04-29 14:10:20] [INFO] No preview.env file found - using environment variables only [2026-04-29 14:10:20] [SUBSTEP] Configuring Pipeline Service secrets Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation product-kubearchive-logging namespace already exists, skipping creation Creating DB secret DB secret already exists, skipping creation Creating S3 secret S3 secret already exists, skipping creation Creating S3 secret S3 secret already exists, skipping creation Creating Postgres TLS certs Postgres DB cert secret already exists, skipping creation [2026-04-29 14:10:21] [SUCCESS] Pipeline Service secrets configured [2026-04-29 14:10:21] [SUBSTEP] Configuring GitHub secrets [2026-04-29 14:10:21] [INFO] GitHub token provided - creating secrets namespace/application-service configured Creating a has secret from legacy token secret/has-github-token configured [2026-04-29 14:10:22] [SUCCESS] GitHub secrets configured [2026-04-29 14:10:22] [SUBSTEP] Configuring Image Controller secrets [2026-04-29 14:10:22] [INFO] Quay organization: redhat-appstudio-qe Creating a secret with a token for Image Controller namespace/image-controller configured secret/quaytoken configured [2026-04-29 14:10:24] [SUCCESS] Image Controller secrets configured [2026-04-29 14:10:24] [SUCCESS] Member cluster bootstrap complete ============================================================================= [2026-04-29 14:10:24] [STEP] Phase 4: Bootstrapping Common Components ============================================================================= [2026-04-29 14:10:24] [INFO] Bootstrapping common cluster components [2026-04-29 14:10:24] [INFO] No preview.env file found at /tmp/tmp.dHmAIdSIvq/tmp/infra-deployments/hack/../hack/preview.env - using environment variables only [2026-04-29 14:10:24] [SUBSTEP] Configuring Docker Hub pull secret Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.rhHqviHmIi secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.rhHqviHmIi secret/docker-io-pull configured [2026-04-29 14:10:25] [SUCCESS] Docker Hub pull secret configured [2026-04-29 14:10:25] [SUBSTEP] Configuring DORA metrics exporter secrets Setting secrets for Dora metrics exporter namespace/dora-metrics configured [2026-04-29 14:10:26] [SUCCESS] DORA metrics exporter secrets configured [2026-04-29 14:10:26] [SUCCESS] Common cluster bootstrap complete ============================================================================= [2026-04-29 14:10:26] [STEP] Phase 5: Mode-Specific Deployment (preview) ============================================================================= [2026-04-29 14:10:26] [INFO] Deploying preview configuration ============================================================================= [2026-04-29 14:10:26] [STEP] Starting Konflux Preview Environment Setup ============================================================================= [2026-04-29 14:10:26] [INFO] Script: /tmp/tmp.dHmAIdSIvq/tmp/infra-deployments/hack/../hack/preview.sh [2026-04-29 14:10:26] [INFO] Options: OBO=false, GRAFANA=false, EAAS=false [2026-04-29 14:10:26] [INFO] Start time: 2026-04-29 14:10:26 UTC ============================================================================= [2026-04-29 14:10:26] [STEP] Cluster Context Information ============================================================================= [2026-04-29 14:10:26] [INFO] OpenShift Version: 4.18.9 [2026-04-29 14:10:26] [INFO] API Server: https://api.kx-849bccb8ec.ajj5.p3.openshiftapps.com:443 [2026-04-29 14:10:26] [INFO] Cluster ID: 89d33736-9972-40c7-891a-539e9d61559d [2026-04-29 14:10:26] [INFO] Cluster Domain: apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com [2026-04-29 14:10:26] [INFO] Total Nodes: 3 [2026-04-29 14:10:27] [INFO] - Master nodes: 0 [2026-04-29 14:10:27] [INFO] - Worker nodes: 3 [2026-04-29 14:10:27] [SUCCESS] Cluster operators: All healthy [CLUSTER_CONTEXT_JSON] {"ocp_version":"4.18.9","api_server":"https://api.kx-849bccb8ec.ajj5.p3.openshiftapps.com:443","cluster_id":"89d33736-9972-40c7-891a-539e9d61559d","cluster_domain":"apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com","total_nodes":3,"master_nodes":0,"worker_nodes":3,"degraded_operators":0} Switched to a new branch 'preview-main-dhzz' [2026-04-29 14:10:27] [SUCCESS] Git environment initialized [2026-04-29 14:10:27] [INFO] - Repository URL: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-04-29 14:10:27] [INFO] - Source branch: main [2026-04-29 14:10:27] [INFO] - Preview branch: preview-main-dhzz [2026-04-29 14:10:27] [INFO] - GitHub org: redhat-appstudio-qe ============================================================================= [2026-04-29 14:10:27] [STEP] Patching ArgoCD application manifests to use fork repository ============================================================================= [2026-04-29 14:10:27] [INFO] Setting repoURL to: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-04-29 14:10:27] [INFO] Setting targetRevision to: preview-main-dhzz [2026-04-29 14:10:27] [SUBSTEP] Patched: application-patch.yaml [2026-04-29 14:10:27] [SUBSTEP] Patched: application-set-patch.yaml [2026-04-29 14:10:27] [SUBSTEP] Patched: application-set-multisrc-src-1-patch.yaml [2026-04-29 14:10:27] [SUCCESS] All ArgoCD patch files updated ============================================================================= [2026-04-29 14:10:27] [STEP] Labeling cluster nodes for Konflux workloads ============================================================================= [2026-04-29 14:10:27] [INFO] Reference: https://github.com/redhat-appstudio/infra-deployments/pull/4415 [2026-04-29 14:10:27] [INFO] Found 3 nodes to label with 'konflux-ci.dev/workload=konflux-tenants' [2026-04-29 14:10:27] [SUBSTEP] Labeling node/ip-10-0-140-223.ec2.internal node/ip-10-0-140-223.ec2.internal not labeled [2026-04-29 14:10:27] [SUCCESS] Successfully labeled node/ip-10-0-140-223.ec2.internal [2026-04-29 14:10:27] [SUBSTEP] Labeling node/ip-10-0-157-36.ec2.internal node/ip-10-0-157-36.ec2.internal not labeled [2026-04-29 14:10:27] [SUCCESS] Successfully labeled node/ip-10-0-157-36.ec2.internal [2026-04-29 14:10:27] [SUBSTEP] Labeling node/ip-10-0-160-96.ec2.internal node/ip-10-0-160-96.ec2.internal not labeled [2026-04-29 14:10:28] [SUCCESS] Successfully labeled node/ip-10-0-160-96.ec2.internal [2026-04-29 14:10:28] [SUBSTEP] Verifying labels on all nodes... [2026-04-29 14:10:28] [SUCCESS] All 3 nodes labeled and verified successfully ============================================================================= [2026-04-29 14:10:28] [STEP] Checking OCP version for Kueue compatibility ============================================================================= [2026-04-29 14:10:28] [INFO] Detected OpenShift Container Platform version: 4.18.9 (minor: 18) [2026-04-29 14:10:28] [SUCCESS] OCP version 4.18.9 meets Kueue requirements - Kueue will be deployed ============================================================================= [2026-04-29 14:10:28] [STEP] Configuring GitHub organization ============================================================================= [2026-04-29 14:10:28] [INFO] Setting GitHub org to: redhat-appstudio-qe [2026-04-29 14:10:28] [INFO] Configuring GitHub organization for Application Service (HAS) [2026-04-29 14:10:28] [INFO] - Target org: redhat-appstudio-qe [2026-04-29 14:10:28] [INFO] - Config file: /tmp/tmp.dHmAIdSIvq/tmp/infra-deployments/hack/../components/has/base/kustomization.yaml [2026-04-29 14:10:28] [SUCCESS] GitHub organization set to 'redhat-appstudio-qe' [2026-04-29 14:10:28] [SUCCESS] Verified: Configuration updated correctly [2026-04-29 14:10:28] [SUCCESS] GitHub organization configured ============================================================================= [2026-04-29 14:10:28] [STEP] Configuring Rekor server hostname ============================================================================= [2026-04-29 14:10:28] [INFO] Cluster domain: apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com [2026-04-29 14:10:28] [INFO] Rekor server hostname: rekor.apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com [2026-04-29 14:10:28] [SUCCESS] Rekor server hostname configured ============================================================================= [2026-04-29 14:10:28] [STEP] Applying service image overrides from environment variables ============================================================================= [2026-04-29 14:10:28] [INFO] No service image overrides configured - using default images ============================================================================= [2026-04-29 14:10:28] [STEP] Committing and pushing preview changes ============================================================================= [preview-main-dhzz cb3cb75db] Preview mode, do not merge into main 8 files changed, 15 insertions(+), 19 deletions(-) remote: remote: Create a pull request for 'preview-main-dhzz' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-dhzz remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-dhzz -> preview-main-dhzz branch 'preview-main-dhzz' set up to track 'qe/preview-main-dhzz'. [2026-04-29 14:10:29] [SUCCESS] Preview changes committed and pushed to qe/preview-main-dhzz ============================================================================= [2026-04-29 14:10:29] [STEP] Deploying ArgoCD applications ============================================================================= [2026-04-29 14:10:29] [SUBSTEP] Applying root Application from: /tmp/tmp.dHmAIdSIvq/tmp/infra-deployments/hack/../argo-cd-apps/app-of-app-sets/development application.argoproj.io/all-application-sets configured [2026-04-29 14:10:30] [SUCCESS] Root Application 'all-application-sets' created [2026-04-29 14:10:30] [SUBSTEP] Waiting for 'all-application-sets' to become Healthy and Synced [2026-04-29 14:10:30] [SUCCESS] Root application 'all-application-sets' is Healthy and Synced [2026-04-29 14:10:30] [SUBSTEP] Triggering hard refresh on all ArgoCD applications [2026-04-29 14:10:30] [INFO] Found 44 applications to refresh application.argoproj.io/konflux-info-in-cluster-local patched application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/dora-metrics-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/image-rbac-proxy-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/has-in-cluster-local patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/monitoring-registry-in-cluster-local patched application.argoproj.io/disaster-recovery-in-cluster-local patched application.argoproj.io/smee-client-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/monitoring-cardinality-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/monitoring-workload-custom-kube-state-metrics-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/backup-in-cluster-local patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched application.argoproj.io/postgres patched application.argoproj.io/pipeline-service-in-cluster-local patched [2026-04-29 14:10:40] [SUCCESS] Hard refresh triggered on all 44 applications [2026-04-29 14:10:40] [SUBSTEP] Waiting for refresh operations to complete [2026-04-29 14:10:40] [PROGRESS] Refresh: 3/44 complete | 41 still refreshing (5s elapsed) [2026-04-29 14:10:46] [PROGRESS] Refresh: 15/44 complete | 29 still refreshing (10s elapsed) [2026-04-29 14:10:51] [PROGRESS] Refresh: 24/44 complete | 20 still refreshing (15s elapsed) [2026-04-29 14:10:57] [PROGRESS] Refresh: 33/44 complete | 11 still refreshing (20s elapsed) [2026-04-29 14:11:02] [PROGRESS] Refresh: 40/44 complete | 4 still refreshing (25s elapsed) [2026-04-29 14:11:07] [PROGRESS] Refresh: 42/44 complete | 2 still refreshing (30s elapsed) [2026-04-29 14:11:13] [PROGRESS] Refresh: 42/44 complete | 2 still refreshing (35s elapsed) [2026-04-29 14:11:18] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (40s elapsed) [2026-04-29 14:11:23] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (45s elapsed) [2026-04-29 14:11:29] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (50s elapsed) [2026-04-29 14:11:34] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (55s elapsed) [2026-04-29 14:11:40] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (60s elapsed) [2026-04-29 14:11:45] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (65s elapsed) [2026-04-29 14:11:50] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (70s elapsed) [2026-04-29 14:11:56] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (75s elapsed) [2026-04-29 14:12:01] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (80s elapsed) [2026-04-29 14:12:06] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (85s elapsed) [2026-04-29 14:12:12] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (90s elapsed) [2026-04-29 14:12:17] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (95s elapsed) [2026-04-29 14:12:22] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (100s elapsed) [2026-04-29 14:12:28] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (105s elapsed) [2026-04-29 14:12:33] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (110s elapsed) [2026-04-29 14:12:38] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (115s elapsed) [2026-04-29 14:12:44] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (120s elapsed) [2026-04-29 14:12:49] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (125s elapsed) [2026-04-29 14:12:55] [PROGRESS] Refresh: 43/44 complete | 1 still refreshing (130s elapsed) [2026-04-29 14:13:00] [SUCCESS] All 44 applications refreshed ============================================================================= [2026-04-29 14:13:00] [STEP] Waiting for all ArgoCD applications to sync and become healthy ============================================================================= [2026-04-29 14:13:00] [INFO] Timeout: 2700 seconds (45 minutes) [2026-04-29 14:13:00] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 0s elapsed) [2026-04-29 14:13:00] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:13:00] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:13:10] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 10s elapsed) [2026-04-29 14:13:10] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:13:10] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:13:20] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 20s elapsed) [2026-04-29 14:13:20] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:13:20] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:13:31] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 30s elapsed) [2026-04-29 14:13:31] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:13:31] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:13:41] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 41s elapsed) [2026-04-29 14:13:41] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:13:41] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:13:51] [PROGRESS] Applications: 43/44 ready | 1 pending (0m 51s elapsed) [2026-04-29 14:13:51] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:13:51] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:14:01] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 1s elapsed) [2026-04-29 14:14:01] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:14:01] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:14:11] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 11s elapsed) [2026-04-29 14:14:11] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:14:11] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:14:22] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 21s elapsed) [2026-04-29 14:14:22] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:14:22] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:14:32] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 32s elapsed) [2026-04-29 14:14:32] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:14:32] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:14:42] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 42s elapsed) [2026-04-29 14:14:42] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:14:42] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:14:52] [PROGRESS] Applications: 43/44 ready | 1 pending (1m 52s elapsed) [2026-04-29 14:14:52] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:14:52] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:15:02] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 2s elapsed) [2026-04-29 14:15:02] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:15:02] [SUBSTEP] Detailed status of pending applications: [2026-04-29 14:15:03] [INFO] ├─ App: konflux-kite-in-cluster-local [2026-04-29 14:15:03] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:15:03] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:15:03] [INFO] │ ├─ Out-of-sync resources: 1 [2026-04-29 14:15:03] [INFO] │ └─ Message: No message [2026-04-29 14:15:03] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:15:13] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 13s elapsed) [2026-04-29 14:15:13] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:15:13] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:15:23] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 23s elapsed) [2026-04-29 14:15:23] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:15:23] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:15:33] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 33s elapsed) [2026-04-29 14:15:33] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:15:33] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:15:43] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 43s elapsed) [2026-04-29 14:15:43] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:15:43] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:15:54] [PROGRESS] Applications: 43/44 ready | 1 pending (2m 53s elapsed) [2026-04-29 14:15:54] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:15:54] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:16:04] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 4s elapsed) [2026-04-29 14:16:04] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:16:04] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:16:14] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 14s elapsed) [2026-04-29 14:16:14] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:16:14] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:16:24] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 24s elapsed) [2026-04-29 14:16:24] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:16:24] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:16:34] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 34s elapsed) [2026-04-29 14:16:34] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:16:34] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:16:44] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 44s elapsed) [2026-04-29 14:16:44] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:16:44] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:16:55] [PROGRESS] Applications: 43/44 ready | 1 pending (3m 54s elapsed) [2026-04-29 14:16:55] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:16:55] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:17:05] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 5s elapsed) [2026-04-29 14:17:05] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:17:05] [SUBSTEP] Detailed status of pending applications: [2026-04-29 14:17:05] [INFO] ├─ App: konflux-kite-in-cluster-local [2026-04-29 14:17:05] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:17:05] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:17:05] [INFO] │ ├─ Out-of-sync resources: 1 [2026-04-29 14:17:05] [INFO] │ └─ Message: No message [2026-04-29 14:17:05] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:17:15] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 15s elapsed) [2026-04-29 14:17:15] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:17:15] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:17:25] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 25s elapsed) [2026-04-29 14:17:25] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:17:26] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:17:36] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 36s elapsed) [2026-04-29 14:17:36] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:17:36] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:17:46] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 46s elapsed) [2026-04-29 14:17:46] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:17:46] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:17:56] [PROGRESS] Applications: 43/44 ready | 1 pending (4m 56s elapsed) [2026-04-29 14:17:56] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:17:56] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:18:06] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 6s elapsed) [2026-04-29 14:18:06] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:18:06] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:18:16] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 16s elapsed) [2026-04-29 14:18:16] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:18:16] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:18:27] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 26s elapsed) [2026-04-29 14:18:27] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:18:27] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:18:37] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 37s elapsed) [2026-04-29 14:18:37] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:18:37] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:18:47] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 47s elapsed) [2026-04-29 14:18:47] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:18:47] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:18:57] [PROGRESS] Applications: 43/44 ready | 1 pending (5m 57s elapsed) [2026-04-29 14:18:57] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:18:57] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:19:07] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 7s elapsed) [2026-04-29 14:19:07] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:19:07] [SUBSTEP] Detailed status of pending applications: [2026-04-29 14:19:08] [INFO] ├─ App: konflux-kite-in-cluster-local [2026-04-29 14:19:08] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:19:08] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:19:08] [INFO] │ ├─ Out-of-sync resources: 1 [2026-04-29 14:19:08] [INFO] │ └─ Message: No message [2026-04-29 14:19:08] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:19:18] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 18s elapsed) [2026-04-29 14:19:18] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:19:18] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:19:28] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 28s elapsed) [2026-04-29 14:19:28] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:19:28] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:19:38] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 38s elapsed) [2026-04-29 14:19:38] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:19:38] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:19:48] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 48s elapsed) [2026-04-29 14:19:48] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:19:48] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:19:58] [PROGRESS] Applications: 43/44 ready | 1 pending (6m 58s elapsed) [2026-04-29 14:19:59] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:19:59] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:20:09] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 9s elapsed) [2026-04-29 14:20:09] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:20:09] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:20:19] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 19s elapsed) [2026-04-29 14:20:19] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:20:19] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:20:29] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 29s elapsed) [2026-04-29 14:20:29] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:20:29] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:20:39] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 39s elapsed) [2026-04-29 14:20:39] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:20:39] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:20:49] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 49s elapsed) [2026-04-29 14:20:49] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:20:49] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:21:00] [PROGRESS] Applications: 43/44 ready | 1 pending (7m 59s elapsed) [2026-04-29 14:21:00] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:21:00] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:21:10] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 10s elapsed) [2026-04-29 14:21:10] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:21:10] [SUBSTEP] Detailed status of pending applications: [2026-04-29 14:21:10] [INFO] ├─ App: konflux-kite-in-cluster-local [2026-04-29 14:21:10] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:21:10] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:21:10] [INFO] │ ├─ Out-of-sync resources: 1 [2026-04-29 14:21:10] [INFO] │ └─ Message: No message [2026-04-29 14:21:10] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:21:20] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 20s elapsed) [2026-04-29 14:21:20] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:21:20] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:21:30] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 30s elapsed) [2026-04-29 14:21:30] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:21:30] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:21:41] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 40s elapsed) [2026-04-29 14:21:41] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:21:41] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:21:51] [PROGRESS] Applications: 43/44 ready | 1 pending (8m 51s elapsed) [2026-04-29 14:21:51] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:21:51] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:22:01] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 1s elapsed) [2026-04-29 14:22:01] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:22:01] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:22:11] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 11s elapsed) [2026-04-29 14:22:11] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:22:11] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:22:21] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 21s elapsed) [2026-04-29 14:22:21] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:22:21] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:22:32] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 31s elapsed) [2026-04-29 14:22:32] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:22:32] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:22:42] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 42s elapsed) [2026-04-29 14:22:42] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:22:42] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:22:52] [PROGRESS] Applications: 43/44 ready | 1 pending (9m 52s elapsed) [2026-04-29 14:22:52] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:22:52] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:23:02] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 2s elapsed) [2026-04-29 14:23:02] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:23:02] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:23:12] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 12s elapsed) [2026-04-29 14:23:12] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:23:12] [SUBSTEP] Detailed status of pending applications: [2026-04-29 14:23:13] [INFO] ├─ App: konflux-kite-in-cluster-local [2026-04-29 14:23:13] [INFO] │ ├─ Sync Status: OutOfSync [2026-04-29 14:23:13] [INFO] │ ├─ Health Status: Healthy [2026-04-29 14:23:13] [INFO] │ ├─ Out-of-sync resources: 1 [2026-04-29 14:23:13] [INFO] │ └─ Message: No message [2026-04-29 14:23:13] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:23:23] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 23s elapsed) [2026-04-29 14:23:23] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:23:23] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:23:33] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 33s elapsed) [2026-04-29 14:23:33] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:23:33] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:23:43] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 43s elapsed) [2026-04-29 14:23:43] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:23:43] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:23:53] [PROGRESS] Applications: 43/44 ready | 1 pending (10m 53s elapsed) [2026-04-29 14:23:53] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:23:53] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:24:04] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 3s elapsed) [2026-04-29 14:24:04] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:24:04] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:24:14] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 14s elapsed) [2026-04-29 14:24:14] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:24:14] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:24:24] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 24s elapsed) [2026-04-29 14:24:24] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:24:24] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:24:34] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 34s elapsed) [2026-04-29 14:24:34] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:24:34] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:24:44] [PROGRESS] Applications: 43/44 ready | 1 pending (11m 44s elapsed) [2026-04-29 14:24:44] [INFO] Pending: konflux-kite-in-cluster-local [2026-04-29 14:24:44] [WAITING] Waiting 10 seconds before next sync check... [2026-04-29 14:24:55] [PROGRESS] Applications: 44/44 ready | 0 pending (11m 54s elapsed) [2026-04-29 14:24:55] [SUCCESS] All 44 ArgoCD applications are Synced and Healthy in 11m 54s ============================================================================= [2026-04-29 14:24:55] [STEP] Waiting for Tekton components to be ready ============================================================================= [2026-04-29 14:24:55] [INFO] Reference: https://tekton.dev/docs/operator/tektonconfig/#tekton-config [2026-04-29 14:24:55] [INFO] Timeout: 900 seconds (15 minutes) [2026-04-29 14:24:55] [PROGRESS] Tekton readiness check iteration 1: status=True (0m 0s elapsed) [2026-04-29 14:24:55] [SUCCESS] All Tekton components are installed and ready in 0m 0s ============================================================================= [2026-04-29 14:24:55] [STEP] Waiting for Tekton CRDs to be available ============================================================================= [2026-04-29 14:24:55] [PROGRESS] Tekton CRD check attempt 1/5 [2026-04-29 14:24:55] [SUCCESS] All required Tekton CRDs are available: pipelines tasks pipelineruns taskruns ============================================================================= [2026-04-29 14:24:55] [STEP] Configuring Pipelines as Code integration ============================================================================= [2026-04-29 14:24:55] [INFO] ============================================================================= [2026-04-29 14:24:55] [INFO] Pipelines as Code (PAC) Integration Setup [2026-04-29 14:24:55] [INFO] ============================================================================= [2026-04-29 14:24:55] [INFO] PAC Namespace: openshift-pipelines [2026-04-29 14:24:55] [INFO] PAC Secret Name: pipelines-as-code-secret [2026-04-29 14:24:55] [INFO] Integration Namespace: integration-service [2026-04-29 14:24:55] [INFO] Authentication method: GitHub App [2026-04-29 14:24:55] [INFO] - GitHub App ID: 310332 [2026-04-29 14:24:55] [INFO] Using existing QE sprayproxy configuration (webhook secret provided) [2026-04-29 14:24:55] [SUCCESS] GitHub App credentials configured [2026-04-29 14:24:55] [INFO] GitHub token provided via MY_GITHUB_TOKEN (fallback) [2026-04-29 14:24:55] [DEBUG] No GitLab token provided (PAC_GITLAB_TOKEN not set) [2026-04-29 14:24:55] [INFO] Creating required namespaces [2026-04-29 14:24:55] [SUBSTEP] Ensuring namespace 'openshift-pipelines' exists [2026-04-29 14:24:55] [DEBUG] Namespace 'openshift-pipelines' already exists [2026-04-29 14:24:55] [SUBSTEP] Ensuring namespace 'build-service' exists [2026-04-29 14:24:55] [DEBUG] Namespace 'build-service' already exists [2026-04-29 14:24:55] [SUBSTEP] Ensuring namespace 'integration-service' exists [2026-04-29 14:24:55] [DEBUG] Namespace 'integration-service' already exists [2026-04-29 14:24:55] [INFO] Configuring PAC secrets across namespaces [2026-04-29 14:24:55] [SUBSTEP] Creating PAC secret in namespace 'openshift-pipelines' secret/pipelines-as-code-secret created [2026-04-29 14:24:56] [SUCCESS] PAC secret configured in 'openshift-pipelines' [2026-04-29 14:24:56] [SUBSTEP] Creating PAC secret in namespace 'build-service' secret/pipelines-as-code-secret created [2026-04-29 14:24:56] [SUCCESS] PAC secret configured in 'build-service' [2026-04-29 14:24:56] [SUBSTEP] Creating PAC secret in namespace 'integration-service' secret/pipelines-as-code-secret created [2026-04-29 14:24:57] [SUCCESS] PAC secret configured in 'integration-service' [2026-04-29 14:24:57] [SUBSTEP] Creating PAC secret in namespace 'mintmaker' secret/pipelines-as-code-secret created [2026-04-29 14:24:57] [SUCCESS] PAC secret configured in 'mintmaker' [2026-04-29 14:24:57] [INFO] ============================================================================= [2026-04-29 14:24:57] [SUCCESS] PAC Integration Setup Complete [2026-04-29 14:24:57] [INFO] ============================================================================= [2026-04-29 14:24:57] [INFO] Configured namespaces: [2026-04-29 14:24:57] [INFO] - openshift-pipelines (PAC controller) [2026-04-29 14:24:57] [INFO] - build-service (Build Service) [2026-04-29 14:24:57] [INFO] - integration-service (Integration Service) [2026-04-29 14:24:57] [INFO] - mintmaker (Mintmaker) [PAC_SETUP_JSON] {"status":"success","namespaces":["openshift-pipelines","build-service","integration-service","mintmaker"],"github_app_configured":true,"github_token_configured":true,"gitlab_token_configured":false} [2026-04-29 14:24:57] [SUCCESS] Pipelines as Code configured ============================================================================= [2026-04-29 14:24:57] [STEP] Preview Environment Setup Complete ============================================================================= [2026-04-29 14:24:57] [SUCCESS] Konflux preview environment is ready! [2026-04-29 14:24:57] [INFO] - Fork: https://github.com/redhat-appstudio-qe/infra-deployments.git [2026-04-29 14:24:57] [INFO] - Branch: preview-main-dhzz [2026-04-29 14:24:57] [INFO] - GitHub Org: redhat-appstudio-qe [2026-04-29 14:24:57] [INFO] - OpenShift Version: 4.18.9 [2026-04-29 14:24:57] [INFO] - End time: 2026-04-29 14:24:57 UTC ============================================================================= [2026-04-29 14:24:57] [STEP] Execution Summary ============================================================================= [2026-04-29 14:24:57] [SUCCESS] Status: SUCCESS [2026-04-29 14:24:57] [INFO] Total Execution Time: 14m 31s (871 seconds) [2026-04-29 14:24:57] [INFO] Applications Deployed: 44 [EXECUTION_SUMMARY_JSON] {"status":"success","total_time_seconds":871,"apps_deployed":44,"ocp_version":"4.18.9","preview_branch":"preview-main-dhzz","git_repo":"https://github.com/redhat-appstudio-qe/infra-deployments.git"} Switched to branch 'main' Your branch is up to date with 'upstream/main'. ============================================================================= [2026-04-29 14:24:57] [STEP] Cluster Bootstrap Complete ============================================================================= [2026-04-29 14:24:58] [SUCCESS] Konflux cluster bootstrap finished successfully [2026-04-29 14:24:58] [INFO] - Mode: preview [2026-04-29 14:24:58] [INFO] - Total time: 14m 46s [2026-04-29 14:24:58] [INFO] - End time: 2026-04-29 14:24:58 UTC [BOOTSTRAP_SUMMARY_JSON] {"status":"success","mode":"preview","obo_enabled":false,"eaas_enabled":false,"total_time_seconds":886} I0429 14:24:58.379170 19486 common.go:429] Registered PaC server: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com I0429 14:24:58.447495 19486 common.go:454] The PaC servers registered in Sprayproxy: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-849bccb8ec.ajj5.p3.openshiftapps.com I0429 14:24:58.447518 19486 common.go:470] going to create new Tekton bundle remote-build for the purpose of testing multi-platform-controller PR I0429 14:24:58.919027 19486 common.go:511] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.9@sha256:62f09c50d552eac57e17638c67e88b0982352a71975858c8ba262bcff293de06 I0429 14:24:58.921081 19486 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777472698-aera -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0429 14:25:00.152791 19486 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777472698-aera: quay.io/redhat-appstudio-qe/test-images@sha256:2f78ef1f3ec89291b240c5fcd1eb3b3f7d1c22979a40b54af3de621db5915cab I0429 14:25:00.152812 19486 common.go:537] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_ARM64 to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777472698-aera I0429 14:25:00.416821 19486 common.go:511] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.9@sha256:62f09c50d552eac57e17638c67e88b0982352a71975858c8ba262bcff293de06 I0429 14:25:00.420505 19486 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777472700-xmjb -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0429 14:25:01.593472 19486 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777472700-xmjb: quay.io/redhat-appstudio-qe/test-images@sha256:f1810de15239b182b231057136a3a394f87ba564af7c3eb89d60d4b9b4755dd7 I0429 14:25:01.593508 19486 common.go:537] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_S390X to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777472700-xmjb I0429 14:25:02.087587 19486 common.go:511] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.9@sha256:62f09c50d552eac57e17638c67e88b0982352a71975858c8ba262bcff293de06 I0429 14:25:02.089365 19486 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777472701-mbiz -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0429 14:25:03.629175 19486 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777472701-mbiz: quay.io/redhat-appstudio-qe/test-images@sha256:73d21cedd63d72e6217c33c5a7a396110703560d4b77e0ae6027f1d51a835803 I0429 14:25:03.629197 19486 common.go:537] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_PPC64LE to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1777472701-mbiz exec: ginkgo "--seed=1777471276" "--timeout=1h30m0s" "--grace-period=30s" "--output-interceptor-mode=none" "--label-filter=!upgrade-create && !upgrade-verify && !upgrade-cleanup && !release-pipelines && !disaster-recovery" "--no-color" "--json-report=e2e-report.json" "--junit-report=e2e-report.xml" "--procs=20" "--nodes=20" "--p" "--output-dir=/workspace/artifact-dir" "./cmd" "--" go: downloading github.com/IBM/go-sdk-core/v5 v5.15.3 go: downloading github.com/IBM/vpc-go-sdk v0.48.0 go: downloading github.com/aws/aws-sdk-go-v2 v1.41.3 go: downloading github.com/aws/aws-sdk-go-v2/service/ec2 v1.143.0 go: downloading github.com/aws/aws-sdk-go-v2/config v1.31.3 go: downloading github.com/konflux-ci/build-service v0.0.0-20240611083846-2dee6cfe6fe4 go: downloading github.com/minio/minio-go/v7 v7.0.99 go: downloading github.com/go-playground/validator/v10 v10.17.0 go: downloading github.com/go-openapi/strfmt v0.25.0 go: downloading github.com/google/go-github/v45 v45.2.0 go: downloading go.mongodb.org/mongo-driver v1.17.7 go: downloading github.com/go-openapi/errors v0.22.6 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/go-viper/mapstructure/v2 v2.4.0 go: downloading github.com/go-playground/universal-translator v0.18.1 go: downloading github.com/leodido/go-urn v1.3.0 go: downloading github.com/gabriel-vasile/mimetype v1.4.3 go: downloading github.com/aws/smithy-go v1.24.2 go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.34.0 go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.18.7 go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3 go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.18.4 go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.38.0 go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.28.2 go: downloading github.com/klauspost/crc32 v1.3.0 go: downloading github.com/minio/crc64nvme v1.1.1 go: downloading github.com/dustin/go-humanize v1.0.1 go: downloading github.com/minio/md5-simd v1.1.2 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/go-playground/locales v0.14.1 go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.4.19 go: downloading github.com/rs/xid v1.6.0 go: downloading github.com/tinylib/msgp v1.6.1 go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.7.19 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.13.6 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.13.19 go: downloading github.com/philhofer/fwd v1.2.0 Running Suite: Red Hat App Studio E2E tests - /tmp/tmp.dHmAIdSIvq/cmd ===================================================================== Random Seed: 1777471276 Will run 357 of 469 specs Running in parallel across 20 processes SSS ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies if release CR is created [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_advisories.go:117 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies the advs release pipelinerun is running and succeeds [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_advisories.go:127 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_advisories.go:157 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies if the repository URL is valid [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_advisories.go:168 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that a Release CR should have been created in the dev namespace [release-pipelines, push-to-external-registry] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/push_to_external_registry.go:157 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that Release PipelineRun should eventually succeed [release-pipelines, push-to-external-registry] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/push_to_external_registry.go:164 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification tests if the image was pushed to quay [release-pipelines, push-to-external-registry] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/push_to_external_registry.go:168 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that a Release is marked as succeeded. [release-pipelines, push-to-external-registry] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/push_to_external_registry.go:175 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies the release CR is created [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/multiarch_advisories.go:112 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies the multiarch release pipelinerun is running and succeeds [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/multiarch_advisories.go:122 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/multiarch_advisories.go:152 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies if the repository URL is valid [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/multiarch_advisories.go:163 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context points to a file [build-templates] /tmp/tmp.dHmAIdSIvq/tests/build/tkn-bundle.go:188 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification tests that Release CR is created for the Snapshot [release-pipelines, rh-push-to-external-registry] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_push_to_external_registry.go:215 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles from specific context [build-templates] /tmp/tmp.dHmAIdSIvq/tests/build/tkn-bundle.go:199 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification verifies a release PipelineRun is started and succeeded in managed namespace [release-pipelines, rh-push-to-external-registry] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_push_to_external_registry.go:226 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context is the root directory [build-templates] /tmp/tmp.dHmAIdSIvq/tests/build/tkn-bundle.go:209 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification validate the result of task create-pyxis-image contains image ids [release-pipelines, rh-push-to-external-registry] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_push_to_external_registry.go:233 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when context points to a file and a directory [build-templates] /tmp/tmp.dHmAIdSIvq/tests/build/tkn-bundle.go:218 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification tests that Release CR has completed [release-pipelines, rh-push-to-external-registry] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_push_to_external_registry.go:248 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when using negation [build-templates] /tmp/tmp.dHmAIdSIvq/tests/build/tkn-bundle.go:228 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification validates that imageIds from task create-pyxis-image exist in Pyxis. [release-pipelines, rh-push-to-external-registry] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_push_to_external_registry.go:265 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding HOME environment variable [build-templates] /tmp/tmp.dHmAIdSIvq/tests/build/tkn-bundle.go:238 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding STEP image [build-templates] /tmp/tmp.dHmAIdSIvq/tests/build/tkn-bundle.go:247 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies if the release CR is created [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_push_to_registry_redhat_io.go:108 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies the rhio release pipelinerun is running and succeeds [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_push_to_registry_redhat_io.go:118 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_push_to_registry_redhat_io.go:148 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies if the MR URL is valid [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rh_push_to_registry_redhat_io.go:159 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:123 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:128 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:132 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-host-pool] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:120 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:136 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies if the release CR is created [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rhtap_service_push.go:150 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-host-pool] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:124 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if release CR is created [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/release_to_github.go:138 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:178 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies the rhtap release pipelinerun is running and succeeds [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rhtap_service_push.go:160 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-host-pool] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:127 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies the release pipelinerun is running and succeeds [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/release_to_github.go:148 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:183 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rhtap_service_push.go:190 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-host-pool] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:148 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/release_to_github.go:181 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created test that cleanup happened successfully [multi-platform, aws-host-pool] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:152 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:187 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies if the PR in infra-deployments repo is created/updated [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/rhtap_service_push.go:200 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:251 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if the Release exists in github repo [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/release_to_github.go:192 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:191 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:255 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:233 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:259 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:238 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:263 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:242 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, aws-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:267 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:246 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmz-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:341 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:286 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmz-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:345 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:291 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmz-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:349 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:295 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmz-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:353 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.dHmAIdSIvq/tests/release/pipelines/fbc_release.go:299 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmz-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:357 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmp-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:432 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmp-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:436 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmp-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:440 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmp-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:444 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmp-dynamic] /tmp/tmp.dHmAIdSIvq/tests/build/multi-platform.go:448 ------------------------------ ••••• ------------------------------ • [FAILED] [93.536 seconds] [integration-service-suite Gitlab Status Reporting of Integration tests] Gitlab with status reporting of Integration tests in the assosiated merge request [BeforeAll] when a new Component with specified custom branch is created triggers a Build PipelineRun [integration-service, gitlab-status-reporting, custom-branch] [BeforeAll] /tmp/tmp.dHmAIdSIvq/tests/integration-service/gitlab-integration-reporting.go:45 [It] /tmp/tmp.dHmAIdSIvq/tests/integration-service/gitlab-integration-reporting.go:130 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.dHmAIdSIvq/tests/integration-service/gitlab-integration-reporting.go:68 @ 04/29/26 14:29:00.039 [FAILED] in [AfterAll] - /tmp/tmp.dHmAIdSIvq/tests/integration-service/gitlab-integration-reporting.go:97 @ 04/29/26 14:29:00.286 << Timeline [FAILED] Unexpected error: <*errors.StatusError | 0xc0006fd0e0>: admission webhook "dintegrationtestscenario.kb.io" denied the request: could not find application 'integ-app-bzgx' in namespace 'gitlab-rep-yqfq' { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "admission webhook \"dintegrationtestscenario.kb.io\" denied the request: could not find application 'integ-app-bzgx' in namespace 'gitlab-rep-yqfq'", Reason: "Forbidden", Details: nil, Code: 403, }, } occurred In [BeforeAll] at: /tmp/tmp.dHmAIdSIvq/tests/integration-service/gitlab-integration-reporting.go:68 @ 04/29/26 14:29:00.039 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSSSSSSSSSSSSSSSSSSSS••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test build secret lookup when two secrets are created when second component is deleted, pac pr branch should not exist in the repo [build-service, github, pac-build, secret-lookup] /tmp/tmp.dHmAIdSIvq/tests/build/secret_lookup.go:206 ------------------------------ • ------------------------------ • [FAILED] [501.244 seconds] [integration-service-suite Status Reporting of Integration tests] with status reporting of Integration tests in CheckRuns when a new Component with specified custom branch is created [It] should lead to build PipelineRun finishing successfully [integration-service, github-status-reporting, custom-branch] /tmp/tmp.dHmAIdSIvq/tests/integration-service/status-reporting-to-pullrequest.go:144 Timeline >> PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Running PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: PipelineRunStopping PipelineRun test-component-pac-ofzhav-on-pull-request-xhg2x reason: Failed [FAILED] in [It] - /tmp/tmp.dHmAIdSIvq/tests/integration-service/status-reporting-to-pullrequest.go:146 @ 04/29/26 14:38:23.322 << Timeline [FAILED] build pipelinerun fails for NameSpace/Application/Component stat-rep-jxln/integ-app-ulnm/test-component-pac-ofzhav with logs: Pipelinerun 'test-component-pac-ofzhav-on-pull-request-xhg2x' didn't succeed Expected success, but got an error: <*errors.errorString | 0xc00160db20>: Pipelinerun 'test-component-pac-ofzhav-on-pull-request-xhg2x' didn't succeed { s: "Pipelinerun 'test-component-pac-ofzhav-on-pull-request-xhg2x' didn't succeed\n", } In [It] at: /tmp/tmp.dHmAIdSIvq/tests/integration-service/status-reporting-to-pullrequest.go:146 @ 04/29/26 14:38:23.322 ------------------------------ SSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [FAILED] [208.512 seconds] [enterprise-contract-suite Conforma E2E tests] test creating and signing an image and task verify-enterprise-contract task [It] succeeds when policy is met [ec, pipeline] /tmp/tmp.dHmAIdSIvq/tests/enterprise-contract/contract.go:177 Timeline >> Copy public key from openshift-pipelines/signing-secrets to a new secret Configured Rekor host: https://rekor.sigstore.dev Using verify EC task bundle: quay.io/conforma/tekton-task:kf-cdfd9188f9352d7269ae1fe8c273a9e67f60ab8a@sha256:3801e78906a70b6dcf850a063cd90b8f5a785b3b54e39ba04630268b08703048 Creating Pipeline "verify-enterprise-contract-run-dcgbj" Waiting for pipeline "verify-enterprise-contract-run-dcgbj" to finish *** TaskRun status: artifacts: {} completionTime: "2026-04-29T14:38:56Z" conditions: - lastTransitionTime: "2026-04-29T14:38:56Z" message: '"step-show-config" exited with code 2: Error' reason: Failed status: "False" type: Succeeded podName: verify-enterprise-contract-f975fdbaf3747d736ae275c714fe05a7-pod provenance: featureFlags: awaitSidecarReadiness: true coschedule: workspaces enableAPIFields: alpha enableParamEnum: true enableProvenanceInStatus: true enforceNonfalsifiability: none maxResultSize: 4096 resultExtractionMethod: termination-message runningInEnvWithInjectedSidecars: true verificationNoMatchPolicy: ignore refSource: digest: sha256: 3801e78906a70b6dcf850a063cd90b8f5a785b3b54e39ba04630268b08703048 entryPoint: verify-enterprise-contract uri: quay.io/conforma/tekton-task spanContext: traceparent: 00-4f165906fd8784f098eed02623bd4485-4fa63a451c0e7f33-01 startTime: "2026-04-29T14:35:30Z" steps: - container: step-initialize-tuf imageID: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: initialize-tuf provenance: {} terminated: containerID: cri-o://1300ce310aaae1b7c86717fe280348bb96950ec8f975f311dc33ce8b6d5122f8 exitCode: 0 finishedAt: "2026-04-29T14:38:49Z" reason: Completed startedAt: "2026-04-29T14:38:49Z" terminationReason: Skipped - container: step-reduce imageID: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: reduce provenance: {} terminated: containerID: cri-o://fde1f8c71386849076cd540e30017c44ec4ed4bb0b674f19fabc7b2ae716265c exitCode: 0 finishedAt: "2026-04-29T14:38:49Z" reason: Completed startedAt: "2026-04-29T14:38:49Z" terminationReason: Completed - container: step-validate imageID: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: validate provenance: {} terminated: containerID: cri-o://50fe18ffb03712750541d0e4f319038b7299ef839810cfc0adec57e87a65afaf exitCode: 1 finishedAt: "2026-04-29T14:38:54Z" reason: Completed startedAt: "2026-04-29T14:38:49Z" terminationReason: Continued - container: step-report-json imageID: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: report-json provenance: {} terminated: containerID: cri-o://00090bccfa02ec3e9e82552d3e2b46c9a1defd5e6ef80abf4c2b3ea386db4e94 exitCode: 0 finishedAt: "2026-04-29T14:38:55Z" reason: Completed startedAt: "2026-04-29T14:38:54Z" terminationReason: Completed - container: step-summary imageID: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: summary provenance: {} terminated: containerID: cri-o://7e7ae468631f754979d2a549edac15cdc7f62cfdfb71d2619b6de70834f5ff9b exitCode: 2 finishedAt: "2026-04-29T14:38:55Z" reason: Completed startedAt: "2026-04-29T14:38:55Z" terminationReason: Continued - container: step-info imageID: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: info provenance: {} terminated: containerID: cri-o://9d1d1f0a4a7f732f21625fd76bb873c1660b537d381068fe8fee03bfa7c2f00b exitCode: 0 finishedAt: "2026-04-29T14:38:55Z" reason: Completed startedAt: "2026-04-29T14:38:55Z" terminationReason: Completed - container: step-version imageID: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: version provenance: {} terminated: containerID: cri-o://5e3704ed5730c0d8f6d757ea5e0f242de46e09db1afbcfab627c4ed7407a8fb8 exitCode: 0 finishedAt: "2026-04-29T14:38:55Z" reason: Completed startedAt: "2026-04-29T14:38:55Z" terminationReason: Completed - container: step-show-config imageID: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: show-config provenance: {} terminated: containerID: cri-o://b52c13ddf97532f0d4fa122b6a55bc8964e75eb7c566ee5034615b166c41d150 exitCode: 2 finishedAt: "2026-04-29T14:38:55Z" reason: Error startedAt: "2026-04-29T14:38:55Z" terminationReason: Error - container: step-assert imageID: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: assert provenance: {} terminated: containerID: cri-o://c09206ffbcff95ca23b3f7331b342c4d88b87765c1a0ab20a765c5dd2ec24173 exitCode: 1 finishedAt: "2026-04-29T14:38:55Z" reason: Error startedAt: "2026-04-29T14:38:55Z" terminationReason: Skipped taskSpec: description: Verify the enterprise contract is met params: - description: | Spec section of an ApplicationSnapshot resource. Not all fields of the resource are required. A minimal example: ```json { "components": [ { "containerImage": "quay.io/example/repo:latest" } ] } ``` Each `containerImage` in the `components` array is validated. name: IMAGES type: string - default: enterprise-contract-service/default description: | Name of the policy configuration (EnterpriseContractPolicy resource) to use. `namespace/name` or `name` syntax supported. If namespace is omitted the namespace where the task runs is used. You can also specify a policy configuration using a git url, e.g. `github.com/conforma/config//slsa3`. name: POLICY_CONFIGURATION type: string - default: "" description: Public key used to verify signatures. Must be a valid k8s cosign reference, e.g. k8s://my-space/my-secret where my-secret contains the expected cosign.pub attribute. name: PUBLIC_KEY type: string - default: "" description: Rekor host for transparency log lookups name: REKOR_HOST type: string - default: "false" description: Skip Rekor transparency log checks during validation. name: IGNORE_REKOR type: string - default: "" description: TUF mirror URL. Provide a value when NOT using public sigstore deployment. name: TUF_MIRROR type: string - default: "" description: | Path to a directory containing SSL certs to be used when communicating with external services. This is useful when using the integrated registry and a local instance of Rekor on a development cluster which may use certificates issued by a not-commonly trusted root CA. In such cases, `/var/run/secrets/kubernetes.io/serviceaccount` is a good value. Multiple paths can be provided by using the `:` separator. name: SSL_CERT_DIR type: string - default: trusted-ca description: The name of the ConfigMap to read CA bundle data from. name: CA_TRUST_CONFIGMAP_NAME type: string - default: ca-bundle.crt description: The name of the key in the ConfigMap that contains the CA bundle data. name: CA_TRUST_CONFIG_MAP_KEY type: string - default: "true" description: Include rule titles and descriptions in the output. Set to `"false"` to disable it. name: INFO type: string - default: "true" description: Fail the task if policy fails. Set to `"false"` to disable it. name: STRICT type: string - default: /tekton/home description: Value for the HOME environment variable. name: HOMEDIR type: string - default: now description: Run policy checks with the provided time. name: EFFECTIVE_TIME type: string - default: "" description: Merge additional Rego variables into the policy data. Use syntax "key=value,key2=value2..." name: EXTRA_RULE_DATA type: string - default: "" description: | This param is deprecated and will be removed in future. Its value is ignored. EC will be run without a timeout. (If you do want to apply a timeout use the Tekton task timeout.) name: TIMEOUT type: string - default: "1" description: Number of parallel workers to use for policy evaluation. name: WORKERS type: string - default: "false" description: Reduce the Snapshot to only the component whose build caused the Snapshot to be created name: SINGLE_COMPONENT type: string - default: unknown description: | Name, including kind, of the Kubernetes resource to query for labels when single component mode is enabled, e.g. pr/somepipeline. name: SINGLE_COMPONENT_CUSTOM_RESOURCE type: string - default: "" description: | Kubernetes namespace where the SINGLE_COMPONENT_NAME is found. Only used when single component mode is enabled. name: SINGLE_COMPONENT_CUSTOM_RESOURCE_NS type: string results: - description: Short summary of the policy evaluation for each image name: TEST_OUTPUT type: string stepTemplate: computeResources: {} env: - name: HOME value: /tekton/home steps: - args: - sigstore - initialize - --mirror - "" - --root - /root.json command: - ec computeResources: limits: memory: 256Mi requests: cpu: 100m memory: 256Mi image: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: initialize-tuf when: - operator: notin values: - "" - command: - reduce-snapshot.sh computeResources: limits: memory: 256Mi requests: cpu: 100m memory: 256Mi env: - name: SNAPSHOT value: '{"application":"","componentGroup":"","components":[{"name":"","version":"","containerImage":"quay.io/redhat-appstudio-qe/test-images:buildah-demo-aqregjowwl@sha256:3e3420bceef6d9c28edce2e7d717ef749f33eabefb9156da357677b2985252b0","source":{}}],"artifacts":{}}' - name: SINGLE_COMPONENT value: "false" - name: CUSTOM_RESOURCE value: unknown - name: CUSTOM_RESOURCE_NAMESPACE - name: SNAPSHOT_PATH value: /tekton/home/snapshot.json image: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: reduce onError: continue - args: - validate - image - --images - /tekton/home/snapshot.json - --policy - ec-policy - --public-key - k8s://chains-e2e-msya/cosign-public-key - --rekor-url - "" - --ignore-rekor=true - --workers - "1" - --info=true - --timeout=100h - --strict=false - --show-successes - --effective-time=now - --extra-rule-data= - --output - text?show-successes=false - --output - appstudio=/tekton/results/TEST_OUTPUT - --output - json=/tekton/home/report-json.json command: - ec computeResources: limits: memory: 2Gi requests: cpu: 1800m memory: 2Gi env: - name: SSL_CERT_DIR value: /tekton-custom-certs:/etc/ssl/certs:/etc/pki/tls/certs:/system/etc/security/cacerts:/var/run/secrets/kubernetes.io/serviceaccount - name: EC_CACHE value: "false" image: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: validate onError: continue volumeMounts: - mountPath: /etc/pki/tls/certs/ca-custom-bundle.crt name: trusted-ca readOnly: true subPath: ca-bundle.crt - args: - jq . /tekton/home/report-json.json | awk '{gsub(/^ +/, ""); acc += length; if (acc >= 8000) { printf "\n"; acc=length } printf $0 }' command: - sh - -c computeResources: limits: memory: 256Mi requests: cpu: 100m memory: 256Mi image: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: report-json onError: continue - args: - . - /tekton/results/TEST_OUTPUT command: - jq computeResources: limits: memory: 256Mi requests: cpu: 100m memory: 256Mi image: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: summary onError: continue - args: - | ----- DEBUG OUTPUT ----- command: - printf computeResources: limits: memory: 256Mi requests: cpu: 100m memory: 256Mi image: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: info - args: - version command: - ec computeResources: limits: memory: 256Mi requests: cpu: 100m memory: 256Mi image: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: version - args: - '{policy: .policy, key: .key, "effective-time": .["effective-time"]}' - /tekton/home/report-json.json command: - jq computeResources: limits: memory: 256Mi requests: cpu: 100m memory: 256Mi image: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: show-config - args: - --argjson - strict - "true" - -e - | .result == "SUCCESS" or .result == "WARNING" or ($strict | not) - /tekton/results/TEST_OUTPUT command: - jq computeResources: limits: memory: 256Mi requests: cpu: 100m memory: 256Mi image: quay.io/conforma/cli@sha256:9275ec5f062399135ecb3f54f520ee5f20e818a846c34250e0d417dce9221459 name: assert volumes: - configMap: items: - key: ca-bundle.crt path: ca-bundle.crt name: trusted-ca optional: true name: trusted-ca workspaces: - description: The workspace where the snapshot spec json file resides name: data optional: true *** Logs from pod 'verify-enterprise-contract-f975fdbaf3747d736ae275c714fe05a7-pod', container 'step-initialize-tuf': ----- START -----2026/04/29 14:38:49 INFO Step was skipped due to when expressions were evaluated to false. ----- END ----- *** Logs from pod 'verify-enterprise-contract-f975fdbaf3747d736ae275c714fe05a7-pod', container 'step-reduce': ----- START -----Single Component mode? false { "application": "", "componentGroup": "", "components": [ { "name": "", "version": "", "containerImage": "quay.io/redhat-appstudio-qe/test-images:buildah-demo-aqregjowwl@sha256:3e3420bceef6d9c28edce2e7d717ef749f33eabefb9156da357677b2985252b0", "source": {} } ], "artifacts": {} } ----- END ----- *** Logs from pod 'verify-enterprise-contract-f975fdbaf3747d736ae275c714fe05a7-pod', container 'step-validate': ----- START -----Error: error validating image quay.io/redhat-appstudio-qe/test-images:buildah-demo-aqregjowwl@sha256:3e3420bceef6d9c28edce2e7d717ef749f33eabefb9156da357677b2985252b0 of component : load: loading policies: get compiler: 5 errors occurred: /tmp/ec-work-714728863/policy/ecc96998b/policy/lib/sbom/sbom.rego:88: rego_type_error: undefined function ec.oci.image_referrers /tmp/ec-work-714728863/policy/ecc96998b/policy/lib/sbom/sbom.rego:98: rego_type_error: undefined function ec.oci.image_tag_refs /tmp/ec-work-714728863/policy/ecc96998b/policy/release/slsa_build_scripted_build/slsa_build_scripted_build.rego:23: rego_type_error: undefined function ec.oci.image_manifests /tmp/ec-work-714728863/policy/ecc96998b/policy/release/tasks/tasks.rego:37: rego_type_error: undefined function ec.oci.image_manifests /tmp/ec-work-714728863/policy/ecc96998b/policy/release/trusted_task/trusted_task.rego:23: rego_type_error: undefined function ec.oci.image_manifests ----- END ----- *** Logs from pod 'verify-enterprise-contract-f975fdbaf3747d736ae275c714fe05a7-pod', container 'step-report-json': ----- START -----jq: error: Could not open file /tekton/home/report-json.json: No such file or directory ----- END ----- *** Logs from pod 'verify-enterprise-contract-f975fdbaf3747d736ae275c714fe05a7-pod', container 'step-summary': ----- START -----jq: error: Could not open file /tekton/results/TEST_OUTPUT: No such file or directory ----- END ----- *** Logs from pod 'verify-enterprise-contract-f975fdbaf3747d736ae275c714fe05a7-pod', container 'step-info': ----- START ---------- DEBUG OUTPUT ----- ----- END ----- *** Logs from pod 'verify-enterprise-contract-f975fdbaf3747d736ae275c714fe05a7-pod', container 'step-version': ----- START -----Version v0.7.111 Source ID cdfd9188f9352d7269ae1fe8c273a9e67f60ab8a Change date 2025-07-09 12:58:49 +0000 UTC (42 weeks ago) ECC v0.1.112 OPA v0.70.0 Conftest v0.55.0 Cosign v2.4.1 Sigstore v1.8.9 Rekor v1.3.6 Tekton Pipeline v0.63.0 Kubernetes Client v0.31.0 ----- END ----- *** Logs from pod 'verify-enterprise-contract-f975fdbaf3747d736ae275c714fe05a7-pod', container 'step-show-config': ----- START -----jq: error: Could not open file /tekton/home/report-json.json: No such file or directory ----- END ----- *** Logs from pod 'verify-enterprise-contract-f975fdbaf3747d736ae275c714fe05a7-pod', container 'step-assert': ----- START -----2026/04/29 14:38:55 Skipping step because a previous step failed ----- END ----- Make sure TaskRun verify-enterprise-contract of PipelineRun verify-enterprise-contract-run-dcgbj succeeded [FAILED] in [It] - /tmp/tmp.dHmAIdSIvq/tests/enterprise-contract/contract.go:190 @ 04/29/26 14:38:57.85 << Timeline [FAILED] Expected : false to be true In [It] at: /tmp/tmp.dHmAIdSIvq/tests/enterprise-contract/contract.go:190 @ 04/29/26 14:38:57.85 ------------------------------ SSSSSSSS••••••••S••S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build) when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.dHmAIdSIvq/tests/build/build_templates.go:507 ------------------------------ • ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build) when the container image for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic is created and pushed to container registry verify-enterprise-contract check should pass [build, build-templates, HACBS, pipeline-service, pipeline, sbom, slow, build-templates-e2e] /tmp/tmp.dHmAIdSIvq/tests/build/build_templates.go:569 ------------------------------ S ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build) build-definitions ec pipelines runs ec pipeline pipelines/enterprise-contract.yaml [build, build-templates, HACBS, pipeline-service, pipeline, build-templates-e2e] /tmp/tmp.dHmAIdSIvq/tests/build/build_templates.go:744 ------------------------------ ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••S•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta) when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build-oci-ta should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.dHmAIdSIvq/tests/build/build_templates.go:507 ------------------------------ • ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta) when the container image for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic is created and pushed to container registry verify-enterprise-contract check should pass [build, build-templates, HACBS, pipeline-service, pipeline, sbom, slow, build-templates-e2e] /tmp/tmp.dHmAIdSIvq/tests/build/build_templates.go:569 ------------------------------ S ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta) build-definitions ec pipelines runs ec pipeline pipelines/enterprise-contract.yaml [build, build-templates, HACBS, pipeline-service, pipeline, build-templates-e2e] /tmp/tmp.dHmAIdSIvq/tests/build/build_templates.go:744 ------------------------------ •SS•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta-min) when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build-oci-ta-min should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.dHmAIdSIvq/tests/build/build_templates.go:507 ------------------------------ • ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta-min) when the container image for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic is created and pushed to container registry verify-enterprise-contract check should pass [build, build-templates, HACBS, pipeline-service, pipeline, sbom, slow, build-templates-e2e] /tmp/tmp.dHmAIdSIvq/tests/build/build_templates.go:569 ------------------------------ S ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci (docker-build-oci-ta-min) build-definitions ec pipelines runs ec pipeline pipelines/enterprise-contract.yaml [build, build-templates, HACBS, pipeline-service, pipeline, build-templates-e2e] /tmp/tmp.dHmAIdSIvq/tests/build/build_templates.go:744 ------------------------------ •••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider gl PaC component build when the PaC init branch is merged retrigger the pipeline manually [build-service, github-webhook, pac-build, pipeline, image-controller, gitlab, build-custom-branch] /tmp/tmp.dHmAIdSIvq/tests/build/pac_build.go:600 ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider gl PaC component build when the PaC init branch is merged retriggered pipelineRun should eventually finish [build-service, github-webhook, pac-build, pipeline, image-controller, gitlab, build-custom-branch] /tmp/tmp.dHmAIdSIvq/tests/build/pac_build.go:642 ------------------------------ •••••••• ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider fj PaC component build when the PaC init branch is merged retrigger the pipeline manually [build-service, github-webhook, pac-build, pipeline, image-controller, forgejo, build-custom-branch] /tmp/tmp.dHmAIdSIvq/tests/build/pac_build.go:600 ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider fj PaC component build when the PaC init branch is merged retriggered pipelineRun should eventually finish [build-service, github-webhook, pac-build, pipeline, image-controller, forgejo, build-custom-branch] /tmp/tmp.dHmAIdSIvq/tests/build/pac_build.go:642 ------------------------------ •• ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider gh PaC component build when the PaC init branch is merged retrigger the pipeline manually [build-service, github-webhook, pac-build, pipeline, image-controller, github, build-custom-branch] /tmp/tmp.dHmAIdSIvq/tests/build/pac_build.go:600 ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test git provider gh PaC component build when the PaC init branch is merged retriggered pipelineRun should eventually finish [build-service, github-webhook, pac-build, pipeline, image-controller, github, build-custom-branch] /tmp/tmp.dHmAIdSIvq/tests/build/pac_build.go:642 ------------------------------ ••••••••••••••• ------------------------------ • [FAILED] [1215.218 seconds] [build-service-suite Build service E2E tests] test git provider fj component update with renovate when components are created in same namespace [It] should lead to a nudge PR creation for child component [build-service, renovate, multi-component, forgejo] /tmp/tmp.dHmAIdSIvq/tests/build/renovate.go:412 [FAILED] Timed out after 1200.001s. timed out when waiting for component nudge PR to be created in build-nudge-child-fdtvvh repository Expected : false to be true In [It] at: /tmp/tmp.dHmAIdSIvq/tests/build/renovate.go:427 @ 04/29/26 15:07:52.239 ------------------------------ SS ------------------------------ • [FAILED] [1214.262 seconds] [build-service-suite Build service E2E tests] test git provider gh component update with renovate when components are created in same namespace [It] should lead to a nudge PR creation for child component [build-service, renovate, multi-component, github] /tmp/tmp.dHmAIdSIvq/tests/build/renovate.go:412 [FAILED] Timed out after 1200.000s. timed out when waiting for component nudge PR to be created in build-nudge-child-qqymff repository Expected : false to be true In [It] at: /tmp/tmp.dHmAIdSIvq/tests/build/renovate.go:427 @ 04/29/26 15:08:11.19 ------------------------------ SS••••••SSSSSSSSSSSSSSSSSSSSS Summarizing 5 Failures: [FAIL] [integration-service-suite Status Reporting of Integration tests] with status reporting of Integration tests in CheckRuns when a new Component with specified custom branch is created [It] should lead to build PipelineRun finishing successfully [integration-service, github-status-reporting, custom-branch] /tmp/tmp.dHmAIdSIvq/tests/integration-service/status-reporting-to-pullrequest.go:146 [FAIL] [enterprise-contract-suite Conforma E2E tests] test creating and signing an image and task verify-enterprise-contract task [It] succeeds when policy is met [ec, pipeline] /tmp/tmp.dHmAIdSIvq/tests/enterprise-contract/contract.go:190 [FAIL] [integration-service-suite Gitlab Status Reporting of Integration tests] Gitlab with status reporting of Integration tests in the assosiated merge request [BeforeAll] when a new Component with specified custom branch is created triggers a Build PipelineRun [integration-service, gitlab-status-reporting, custom-branch] /tmp/tmp.dHmAIdSIvq/tests/integration-service/gitlab-integration-reporting.go:68 [FAIL] [build-service-suite Build service E2E tests] test git provider gh component update with renovate when components are created in same namespace [It] should lead to a nudge PR creation for child component [build-service, renovate, multi-component, github] /tmp/tmp.dHmAIdSIvq/tests/build/renovate.go:427 [FAIL] [build-service-suite Build service E2E tests] test git provider fj component update with renovate when components are created in same namespace [It] should lead to a nudge PR creation for child component [build-service, renovate, multi-component, forgejo] /tmp/tmp.dHmAIdSIvq/tests/build/renovate.go:427 Ran 292 of 469 Specs in 3531.290 seconds FAIL! -- 287 Passed | 5 Failed | 88 Pending | 89 Skipped Ginkgo ran 1 suite in 1h1m14.534690182s Test Suite Failed Error: running "ginkgo --seed=1777471276 --timeout=1h30m0s --grace-period=30s --output-interceptor-mode=none --label-filter=!upgrade-create && !upgrade-verify && !upgrade-cleanup && !release-pipelines && !disaster-recovery --no-color --json-report=e2e-report.json --junit-report=e2e-report.xml --procs=20 --nodes=20 --p --output-dir=/workspace/artifact-dir ./cmd --" failed with exit code 1 make: *** [Makefile:25: ci/test/e2e] Error 1