./mage -v ci:teste2e Running target: CI:TestE2E I0911 15:40:16.658649 16458 magefile.go:521] setting up new custom bundle for testing... I0911 15:40:17.282507 16458 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757605217-lgwl -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: docker-build to image I0911 15:40:18.978546 16458 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757605217-lgwl: quay.io/redhat-appstudio-qe/test-images@sha256:8f9a2867c8745e71b4f549124738872f491d66617ca7830f210e05516e6b5ac4 I0911 15:40:18.978579 16458 magefile.go:527] To use the custom docker bundle locally, run below cmd: export CUSTOM_DOCKER_BUILD_PIPELINE_BUNDLE=quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757605217-lgwl I0911 15:40:20.081961 16458 release_service_catalog.go:104] checking if repository is release-service-catalog I0911 15:40:20.081983 16458 integration_service.go:49] checking if repository is integration-service I0911 15:40:20.081989 16458 image_controller.go:49] checking if repository is image-controller I0911 15:40:20.081995 16458 build_service.go:49] checking if repository is build-service I0911 15:40:20.082000 16458 e2e_repo.go:347] checking if repository is e2e-tests I0911 15:40:20.082003 16458 e2e_repo.go:335] multi-platform tests and require sprayproxy registering are set to TRUE exec: git "diff" "--name-status" "upstream/main..HEAD" I0911 15:40:20.084791 16458 util.go:460] The following files, tests/integration-service/group-snapshots-tests.go, were changed! exec: go "install" "-mod=mod" "github.com/onsi/ginkgo/v2/ginkgo" go: downloading github.com/google/pprof v0.0.0-20241210010833-40e02aabc2ad go: downloading github.com/go-task/slim-sprig/v3 v3.0.0 I0911 15:40:23.904864 16458 install.go:188] cloning 'https://github.com/redhat-appstudio/infra-deployments' with git ref 'refs/heads/main' Enumerating objects: 62294, done. Counting objects: 1% (1/63) Counting objects: 3% (2/63) Counting objects: 4% (3/63) Counting objects: 6% (4/63) Counting objects: 7% (5/63) Counting objects: 9% (6/63) Counting objects: 11% (7/63) Counting objects: 12% (8/63) Counting objects: 14% (9/63) Counting objects: 15% (10/63) Counting objects: 17% (11/63) Counting objects: 19% (12/63) Counting objects: 20% (13/63) Counting objects: 22% (14/63) Counting objects: 23% (15/63) Counting objects: 25% (16/63) Counting objects: 26% (17/63) Counting objects: 28% (18/63) Counting objects: 30% (19/63) Counting objects: 31% (20/63) Counting objects: 33% (21/63) Counting objects: 34% (22/63) Counting objects: 36% (23/63) Counting objects: 38% (24/63) Counting objects: 39% (25/63) Counting objects: 41% (26/63) Counting objects: 42% (27/63) Counting objects: 44% (28/63) Counting objects: 46% (29/63) Counting objects: 47% (30/63) Counting objects: 49% (31/63) Counting objects: 50% (32/63) Counting objects: 52% (33/63) Counting objects: 53% (34/63) Counting objects: 55% (35/63) Counting objects: 57% (36/63) Counting objects: 58% (37/63) Counting objects: 60% (38/63) Counting objects: 61% (39/63) Counting objects: 63% (40/63) Counting objects: 65% (41/63) Counting objects: 66% (42/63) Counting objects: 68% (43/63) Counting objects: 69% (44/63) Counting objects: 71% (45/63) Counting objects: 73% (46/63) Counting objects: 74% (47/63) Counting objects: 76% (48/63) Counting objects: 77% (49/63) Counting objects: 79% (50/63) Counting objects: 80% (51/63) Counting objects: 82% (52/63) Counting objects: 84% (53/63) Counting objects: 85% (54/63) Counting objects: 87% (55/63) Counting objects: 88% (56/63) Counting objects: 90% (57/63) Counting objects: 92% (58/63) Counting objects: 93% (59/63) Counting objects: 95% (60/63) Counting objects: 96% (61/63) Counting objects: 98% (62/63) Counting objects: 100% (63/63) Counting objects: 100% (63/63), done. Compressing objects: 2% (1/34) Compressing objects: 5% (2/34) Compressing objects: 8% (3/34) Compressing objects: 11% (4/34) Compressing objects: 14% (5/34) Compressing objects: 17% (6/34) Compressing objects: 20% (7/34) Compressing objects: 23% (8/34) Compressing objects: 26% (9/34) Compressing objects: 29% (10/34) Compressing objects: 32% (11/34) Compressing objects: 35% (12/34) Compressing objects: 38% (13/34) Compressing objects: 41% (14/34) Compressing objects: 44% (15/34) Compressing objects: 47% (16/34) Compressing objects: 50% (17/34) Compressing objects: 52% (18/34) Compressing objects: 55% (19/34) Compressing objects: 58% (20/34) Compressing objects: 61% (21/34) Compressing objects: 64% (22/34) Compressing objects: 67% (23/34) Compressing objects: 70% (24/34) Compressing objects: 73% (25/34) Compressing objects: 76% (26/34) Compressing objects: 79% (27/34) Compressing objects: 82% (28/34) Compressing objects: 85% (29/34) Compressing objects: 88% (30/34) Compressing objects: 91% (31/34) Compressing objects: 94% (32/34) Compressing objects: 97% (33/34) Compressing objects: 100% (34/34) Compressing objects: 100% (34/34), done. Total 62294 (delta 48), reused 29 (delta 29), pack-reused 62231 (from 3) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. Installing the OpenShift GitOps operator subscription: clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created subscription.operators.coreos.com/openshift-gitops-operator created Waiting for default project (and namespace) to exist: ...........................................OK Waiting for OpenShift GitOps Route: OK argocd.argoproj.io/openshift-gitops patched argocd.argoproj.io/openshift-gitops patched Switch the Route to use re-encryption argocd.argoproj.io/openshift-gitops patched Restarting ArgoCD Server pod "openshift-gitops-server-79db7fb858-vjm98" deleted Allow any authenticated users to be admin on the Argo CD instance argocd.argoproj.io/openshift-gitops patched Mark Pending PVC as Healthy, workaround for WaitForFirstConsumer StorageClasses. Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) Setting kustomize build options argocd.argoproj.io/openshift-gitops patched Setting ignore Aggregated Roles argocd.argoproj.io/openshift-gitops patched Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched Restarting GitOps server deployment.apps/openshift-gitops-server restarted ========================================================================= Argo CD URL is: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-453a066208.iu31.p3.openshiftapps.com (NOTE: It may take a few moments for the route to become available) Waiting for the route: .........OK Login/password uses your OpenShift credentials ('Login with OpenShift' button) Setting secrets for Quality Dashboard namespace/quality-dashboard created secret/quality-dashboard-secrets created Creating secret for CI Helper App namespace/ci-helper-app created secret/ci-helper-app-secrets created [WARN] Namespace 'image-controller' does not exist. Creating it... namespace/image-controller created secret/sealights-token created [INFO] Secret 'sealights-token' has been created/updated in namespace 'image-controller'. [WARN] Namespace 'integration-service' does not exist. Creating it... namespace/integration-service created secret/sealights-token created [INFO] Secret 'sealights-token' has been created/updated in namespace 'integration-service'. [WARN] Namespace 'release-service' does not exist. Creating it... namespace/release-service created secret/sealights-token created [INFO] Secret 'sealights-token' has been created/updated in namespace 'release-service'. [WARN] Namespace 'build-service' does not exist. Creating it... namespace/build-service created secret/sealights-token created [INFO] Secret 'sealights-token' has been created/updated in namespace 'build-service'. Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation namespace/product-kubearchive-logging created Creating DB secret secret/tekton-results-database created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config secret/minio-storage-configuration created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config MinIO config already exists, skipping creation Creating Postgres TLS certs ..+.........+....+..+....+...............+.........+...+++++++++++++++++++++++++++++++++++++++*....+.........+..+....+......+...+.....+......+.+++++++++++++++++++++++++++++++++++++++*..+.......+.....+....+.....+.+...+..+.........+.+...++++++ .......+..+......+...+..........+..+....+...+...+++++++++++++++++++++++++++++++++++++++*...+++++++++++++++++++++++++++++++++++++++*...+.+........+......+.+........+.++++++ ----- Certificate request self-signature ok subject=CN=cluster.local .......+.........+++++++++++++++++++++++++++++++++++++++*.....+...+............+...+....+..+...................+.....+.......+.....+++++++++++++++++++++++++++++++++++++++*.+.....+.........+.+...........++++++ ...+..+.+.....+...+....+..+.+..............+++++++++++++++++++++++++++++++++++++++*.........+.......+..+...+++++++++++++++++++++++++++++++++++++++*............+..+.+............+........+.......+..+....+..+.......+...+........+....+......+.................+...+...................+..+......+.......+..+..........+..............................+...+...+...+...........+....+..+....+.....+..........+...+...........+..........+.........+........+.......+...+...+.....+......+...+......+..........+...........+.........+.+.....+......+.......+.....................+..+....+...............+...+...+.........+......+...+..+...+......+...............+.........+......+.+...+..+.........+.............+...........+......+.+...+......+...............+...+..+..........+...+........+...+.......+..+...+......................+...+...+.....+.+...+...+...........................+...........+....+...+........+.......+..+...+.......+........+.............+......+...+..+.+..............+......+...+.+......+..+...+...+.+.....+....+..+.......+...+..................+.....+....+...+..+.+.....+.+...+...+...+.............................+..........+..+......+...++++++ ----- Certificate request self-signature ok subject=CN=postgres-postgresql.tekton-results.svc.cluster.local secret/postgresql-tls created configmap/rds-root-crt created namespace/application-service created Creating a has secret from legacy token secret/has-github-token created Creating a secret with a token for Image Controller Warning: resource namespaces/image-controller is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically. namespace/image-controller configured secret/quaytoken created Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.xpNjddcLU6 secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.xpNjddcLU6 secret/docker-io-pull created serviceaccount/appstudio-pipeline created Setting secrets for Dora metrics exporter namespace/dora-metrics created secret/exporters-secret created Setting Cluster Mode: preview Switched to a new branch 'preview-main-rzwq' labeling node/ip-10-0-137-227.ec2.internal... node/ip-10-0-137-227.ec2.internal labeled successfully labeled node/ip-10-0-137-227.ec2.internal labeling node/ip-10-0-152-120.ec2.internal... node/ip-10-0-152-120.ec2.internal labeled successfully labeled node/ip-10-0-152-120.ec2.internal labeling node/ip-10-0-173-83.ec2.internal... node/ip-10-0-173-83.ec2.internal labeled successfully labeled node/ip-10-0-173-83.ec2.internal verifying labels... all nodes labeled successfully. Detected OCP minor version: 16 Changing AppStudio Gitlab Org to "redhat-appstudio-qe" [preview-main-rzwq 50eeda69] Preview mode, do not merge into main 6 files changed, 12 insertions(+), 18 deletions(-) remote: remote: Create a pull request for 'preview-main-rzwq' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-rzwq remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-rzwq -> preview-main-rzwq branch 'preview-main-rzwq' set up to track 'qe/preview-main-rzwq'. application.argoproj.io/all-application-sets created Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/ingresscontroller-in-cluster-local patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/dev-sso-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/dora-metrics-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/monitoring-workload-grafana-in-cluster-local patched application.argoproj.io/workspaces-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/has-in-cluster-local patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/repository-validator-in-cluster-local patched All Applications are synced and Healthy All required tekton resources are installed and ready Tekton CRDs are ready Setup Pac with existing QE sprayproxy and github App namespace/openshift-pipelines configured namespace/build-service configured namespace/integration-service configured secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created Configured pipelines-as-code-secret secret in openshift-pipelines namespace Switched to branch 'main' Your branch is up to date with 'upstream/main'. [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 83 [running]: > runtime/debug.Stack() > /usr/lib/golang/src/runtime/debug/stack.go:26 +0x5e > sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot() > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.5/pkg/log/log.go:60 +0xcd > sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0xc0004b0f40, {0x2f93fcc, 0x14}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.5/pkg/log/deleg.go:147 +0x3e > github.com/go-logr/logr.Logger.WithName({{0x36ed850, 0xc0004b0f40}, 0x0}, {0x2f93fcc?, 0x0?}) > /opt/app-root/src/go/pkg/mod/github.com/go-logr/logr@v1.4.2/logr.go:345 +0x36 > sigs.k8s.io/controller-runtime/pkg/client.newClient(0x2d71ca0?, {0x0, 0xc0001a0690, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.5/pkg/client/client.go:129 +0xf1 > sigs.k8s.io/controller-runtime/pkg/client.New(0xc000a0db08?, {0x0, 0xc0001a0690, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.5/pkg/client/client.go:110 +0x7d > github.com/konflux-ci/e2e-tests/pkg/clients/kubernetes.NewAdminKubernetesClient() > /tmp/tmp.0IxCbfUvHL/pkg/clients/kubernetes/client.go:157 +0xa5 > github.com/konflux-ci/e2e-tests/pkg/clients/sprayproxy.GetPaCHost() > /tmp/tmp.0IxCbfUvHL/pkg/clients/sprayproxy/sprayproxy.go:93 +0x1c > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.registerPacServer() > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/repos/common.go:426 +0x78 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.init.func8(0xc000a14908?) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/repos/common.go:378 +0x25 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.ActionFunc.Execute(0xc?, 0x2f6ea73?) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/types.go:279 +0x19 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Apply(...) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/types.go:315 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x5246220, 0xc000a14908) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/types.go:348 +0xb3 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x523eca0?, 0xc000d77c00?, 0x1f1bbf9?}, 0xc000a14908) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x52462e0, 0xc000a14908) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/types.go:340 +0x2b > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x5247f60?, 0x7f8b68f73108?, 0x70?}, 0xc000a14908) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).runLoadedCatalog(0x527d990, {0xc00083c288?, 0xc000ed3e60?, 0x47?}, 0xc000a14908) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/types.go:129 +0x119 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).RunRulesOfCategory(0x527d990, {0x2f68e23, 0x2}, 0xc000a14908) > /tmp/tmp.0IxCbfUvHL/magefiles/rulesengine/types.go:121 +0x1b4 > main.CI.TestE2E({}) > /tmp/tmp.0IxCbfUvHL/magefiles/magefile.go:322 +0x18a > main.main.func19({0xc00045c070?, 0xc000656ee0?}) > /tmp/tmp.0IxCbfUvHL/magefiles/mage_output_file.go:827 +0xf > main.main.func12.1() > /tmp/tmp.0IxCbfUvHL/magefiles/mage_output_file.go:302 +0x5b > created by main.main.func12 in goroutine 1 > /tmp/tmp.0IxCbfUvHL/magefiles/mage_output_file.go:297 +0xbe I0911 15:54:31.950092 16458 common.go:434] Registered PaC server: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-453a066208.iu31.p3.openshiftapps.com I0911 15:54:32.017111 16458 common.go:459] The PaC servers registered in Sprayproxy: https://pipelines-as-code-controller-openshift-pipelines.apps.konflux-4-16-us-west-2-xr2tx.konflux-qe.devcluster.openshift.com, https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-453a066208.iu31.p3.openshiftapps.com, https://pipelines-as-code-controller-openshift-pipelines.apps.konflux-4-16-us-west-2-84vft.konflux-qe.devcluster.openshift.com I0911 15:54:32.017177 16458 common.go:475] going to create new Tekton bundle remote-build for the purpose of testing multi-platform-controller PR I0911 15:54:32.450896 16458 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.4@sha256:336cfba0f0c38f57f65a8d8cc67d70c6217a7c6a7fd75b932acb46965e346960 I0911 15:54:32.453434 16458 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757606072-bpsd -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0911 15:54:35.629315 16458 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757606072-bpsd: quay.io/redhat-appstudio-qe/test-images@sha256:f8e8b45fe53e76df3170a4087b7574d3fb56e5dc36edf97af773ddc60085cb50 I0911 15:54:35.629333 16458 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_ARM64 to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757606072-bpsd I0911 15:54:36.520556 16458 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.4@sha256:336cfba0f0c38f57f65a8d8cc67d70c6217a7c6a7fd75b932acb46965e346960 I0911 15:54:36.523396 16458 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757606075-vnqx -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0911 15:54:38.172770 16458 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757606075-vnqx: quay.io/redhat-appstudio-qe/test-images@sha256:a92d6c325a13f55c87d2a0501ab486295fd33c31a4355c3010de24d9abe71a78 I0911 15:54:38.172789 16458 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_S390X to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757606075-vnqx I0911 15:54:38.573325 16458 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.4@sha256:336cfba0f0c38f57f65a8d8cc67d70c6217a7c6a7fd75b932acb46965e346960 I0911 15:54:38.576836 16458 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757606078-otfo -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0911 15:54:40.689374 16458 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757606078-otfo: quay.io/redhat-appstudio-qe/test-images@sha256:0ce7b7b8bd7042f0833940c22be57c5da0b76ded3d897d9de2ad641e4a97a86c I0911 15:54:40.689412 16458 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_PPC64LE to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1757606078-otfo exec: ginkgo "--seed=1757605216" "--timeout=1h30m0s" "--grace-period=30s" "--output-interceptor-mode=none" "--focus-file=tests/integration-service/group-snapshots-tests.go" "--no-color" "--json-report=e2e-report.json" "--junit-report=e2e-report.xml" "--procs=20" "--nodes=20" "--p" "--output-dir=/workspace/artifact-dir" "./cmd" "--" go: downloading github.com/konflux-ci/build-service v0.0.0-20240611083846-2dee6cfe6fe4 go: downloading github.com/IBM/vpc-go-sdk v0.48.0 go: downloading github.com/aws/aws-sdk-go-v2 v1.32.7 go: downloading github.com/aws/aws-sdk-go-v2/service/ec2 v1.135.0 go: downloading github.com/IBM/go-sdk-core/v5 v5.15.3 go: downloading github.com/aws/aws-sdk-go-v2/config v1.28.7 go: downloading github.com/go-playground/validator/v10 v10.17.0 go: downloading github.com/go-openapi/strfmt v0.22.0 go: downloading github.com/google/go-github/v45 v45.2.0 go: downloading go.mongodb.org/mongo-driver v1.13.1 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/asaskevich/govalidator v0.0.0-20230301143203-a9d515a09cc2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/go-openapi/errors v0.21.0 go: downloading github.com/leodido/go-urn v1.3.0 go: downloading github.com/gabriel-vasile/mimetype v1.4.3 go: downloading github.com/go-playground/universal-translator v0.18.1 go: downloading github.com/aws/smithy-go v1.22.1 go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.17.48 go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.22 go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.8.1 go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.24.8 go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.28.7 go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.33.3 go: downloading github.com/go-playground/locales v0.14.1 go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.26 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.1 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.7 go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.26 Running Suite: Red Hat App Studio E2E tests - /tmp/tmp.0IxCbfUvHL/cmd ===================================================================== Random Seed: 1757605216 Will run 39 of 401 specs Running in parallel across 20 processes ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context points to a file [build-templates] /tmp/tmp.0IxCbfUvHL/tests/build/tkn-bundle.go:177 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles from specific context [build-templates] /tmp/tmp.0IxCbfUvHL/tests/build/tkn-bundle.go:188 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context is the root directory [build-templates] /tmp/tmp.0IxCbfUvHL/tests/build/tkn-bundle.go:198 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when context points to a file and a directory [build-templates] /tmp/tmp.0IxCbfUvHL/tests/build/tkn-bundle.go:207 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when using negation [build-templates] /tmp/tmp.0IxCbfUvHL/tests/build/tkn-bundle.go:217 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding HOME environment variable [build-templates] /tmp/tmp.0IxCbfUvHL/tests/build/tkn-bundle.go:227 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding STEP image [build-templates] /tmp/tmp.0IxCbfUvHL/tests/build/tkn-bundle.go:236 ------------------------------ SSSSSSSS ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if release CR is created [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.0IxCbfUvHL/tests/release/pipelines/release_to_github.go:139 ------------------------------ SSS ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies the release pipelinerun is running and succeeds [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.0IxCbfUvHL/tests/release/pipelines/release_to_github.go:149 ------------------------------ SSSS ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.0IxCbfUvHL/tests/release/pipelines/release_to_github.go:182 ------------------------------ SSSSS ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if the Release exists in github repo [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.0IxCbfUvHL/tests/release/pipelines/release_to_github.go:193 ------------------------------ SSSSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when a new Component is created should have a related PaC init PR created [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:77 ------------------------------ SSSSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when a new Component is created triggers a build PipelineRun [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:98 ------------------------------ SSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when a new Component is created verifies if the build PipelineRun contains the finalizer [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:103 ------------------------------ SSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when a new Component is created waits for build PipelineRun to succeed [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:114 ------------------------------ SSSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when the build pipelineRun run succeeded checks if the BuildPipelineRun have the annotation of chains signed [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:122 ------------------------------ SS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when the build pipelineRun run succeeded checks if the Snapshot is created [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:126 ------------------------------ SSSSSS ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.0IxCbfUvHL/tests/build/build_templates.go:478 ------------------------------ SSSSSSSSSSSSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when the build pipelineRun run succeeded checks if the Build PipelineRun got annotated with Snapshot name [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:132 ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when the build pipelineRun run succeeded verifies that the finalizer has been removed from the build pipelinerun [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:136 ------------------------------ SSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when the build pipelineRun run succeeded checks if all of the integrationPipelineRuns passed [integration-service, pipelinerun-resolution, slow] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:149 ------------------------------ SSSSSSSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when the build pipelineRun run succeeded checks if the passed status of integration test is reported in the Snapshot [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:153 ------------------------------ SSSSSSSSSSSSSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when the build pipelineRun run succeeded checks if the finalizer was removed from all of the related Integration pipelineRuns [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:169 ------------------------------ SS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when integration pipelineRun is created it passes, annotations and labels not overwritten by integration service checks integration pipelineRun passed [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:176 ------------------------------ SSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when integration pipelineRun is created it passes, annotations and labels not overwritten by integration service verifies that existing labels and annotations are not overwritten by integration service [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:180 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when integration pipelineRun is created it passes, annotations and labels not overwritten by integration service verifies that PipelinesAsCode specific annotations with dynamic values are preserved [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:226 ------------------------------ SSSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when integration pipelineRun is created it passes, annotations and labels not overwritten by integration service verifies that ResolutionRequest is deleted after pipeline resolution [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:263 ------------------------------ SSSSSS ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build-oci-ta should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.0IxCbfUvHL/tests/build/build_templates.go:478 ------------------------------ SSSSSSS ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when integration pipelineRun is created it passes, annotations and labels not overwritten by integration service verifies that no orphaned ResolutionRequests remain in namespace after test completion [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:287 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test build secret lookup when two secrets are created when second component is deleted, pac pr branch should not exist in the repo [build-service, pac-build, secret-lookup] /tmp/tmp.0IxCbfUvHL/tests/build/build.go:1097 ------------------------------ SSSSSSSSSSSSSSSSSSSSS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-host-pool] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:120 ------------------------------ P [PENDING] [integration-service-suite Integration Service E2E tests ITS PipelineRun Resolution] with happy path for general flow of Integration service when integration pipelineRun is created it passes, annotations and labels not overwritten by integration service validates that second integration pipelineRun failed due to resolution not pipelinerun [integration-service, pipelinerun-resolution] /tmp/tmp.0IxCbfUvHL/tests/integration-service/pipelinerun-resolution.go:320 ------------------------------ SSSSSSSSSS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-host-pool] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:124 ------------------------------ SSSSSS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-host-pool] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:127 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-host-pool] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:148 ------------------------------ SS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created test that cleanup happened successfully [multi-platform, aws-host-pool] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:152 ------------------------------ S ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:251 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:255 ------------------------------ SS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:259 ------------------------------ S ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:263 ------------------------------ SS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, aws-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:267 ------------------------------ S ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmz-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:341 ------------------------------ S ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmz-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:345 ------------------------------ S ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmz-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:349 ------------------------------ S ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmz-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:353 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmz-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:357 ------------------------------ SS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmp-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:432 ------------------------------ S ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmp-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:436 ------------------------------ SS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmp-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:440 ------------------------------ SSSS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmp-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:444 ------------------------------ SS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmp-dynamic] /tmp/tmp.0IxCbfUvHL/tests/build/multi-platform.go:448 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•••• ------------------------------ • [FAILED] [601.503 seconds] [integration-service-suite Creation of group snapshots for monorepo and multiple repos] with status reporting of Integration tests in CheckRuns when we start creation of a new Component A [It] should lead to a PaC PR creation for componentA go-component [integration-service, group-snapshot-creation] /tmp/tmp.0IxCbfUvHL/tests/integration-service/group-snapshots-tests.go:171 [FAILED] Timed out after 600.001s. timed out when waiting for init PaC PR (branch name 'konflux-group-emjdeycl') to be created in group-snapshot-multi-component repository Expected : false to be true In [It] at: /tmp/tmp.0IxCbfUvHL/tests/integration-service/group-snapshots-tests.go:184 @ 09/11/25 16:13:59.667 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS Summarizing 1 Failure: [FAIL] [integration-service-suite Creation of group snapshots for monorepo and multiple repos] with status reporting of Integration tests in CheckRuns when we start creation of a new Component A [It] should lead to a PaC PR creation for componentA go-component [integration-service, group-snapshot-creation] /tmp/tmp.0IxCbfUvHL/tests/integration-service/group-snapshots-tests.go:184 Ran 5 of 401 Specs in 1067.328 seconds FAIL! -- 4 Passed | 1 Failed | 51 Pending | 345 Skipped Ginkgo ran 1 suite in 19m20.597114117s Test Suite Failed Error: running "ginkgo --seed=1757605216 --timeout=1h30m0s --grace-period=30s --output-interceptor-mode=none --focus-file=tests/integration-service/group-snapshots-tests.go --no-color --json-report=e2e-report.json --junit-report=e2e-report.xml --procs=20 --nodes=20 --p --output-dir=/workspace/artifact-dir ./cmd --" failed with exit code 1 make: *** [Makefile:25: ci/test/e2e] Error 1