./mage -v ci:teste2e go: downloading github.com/onsi/ginkgo/v2 v2.27.5 go: downloading golang.org/x/tools v0.41.0 go: downloading github.com/konflux-ci/application-api v0.0.0-20260120144946-dc5c619fb3f9 go: downloading github.com/konflux-ci/integration-service v0.0.0-20260116151929-fade912467b4 go: downloading github.com/konflux-ci/release-service v0.0.0-20260123140112-712630b35e21 go: downloading golang.org/x/net v0.49.0 go: downloading google.golang.org/genproto/googleapis/api v0.0.0-20260122232226-8e98ce8d340d go: downloading golang.org/x/exp v0.0.0-20260112195511-716be5621a96 go: downloading github.com/cloudflare/circl v1.6.3 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20260120174246-409b4a993575 go: downloading google.golang.org/api v0.260.0 go: downloading golang.org/x/mod v0.32.0 Running target: CI:TestE2E I0123 21:37:10.383354 20894 magefile.go:529] setting up new custom bundle for testing... I0123 21:37:10.692896 20894 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204230-kxib -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: docker-build to image I0123 21:37:11.691520 20894 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204230-kxib: quay.io/redhat-appstudio-qe/test-images@sha256:e62131a94373795cf686eee040494d7640c034f69684765aa8017b26ed19f979 I0123 21:37:11.691555 20894 magefile.go:535] To use the custom docker bundle locally, run below cmd: export CUSTOM_DOCKER_BUILD_PIPELINE_BUNDLE=quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204230-kxib I0123 21:37:11.691583 20894 integration_service.go:49] checking if repository is integration-service I0123 21:37:11.691592 20894 image_controller.go:49] checking if repository is image-controller I0123 21:37:11.691602 20894 build_service.go:49] checking if repository is build-service I0123 21:37:11.691608 20894 e2e_repo.go:347] checking if repository is e2e-tests I0123 21:37:11.691614 20894 e2e_repo.go:335] multi-platform tests and require sprayproxy registering are set to TRUE exec: git "diff" "--name-status" "upstream/main..HEAD" I0123 21:37:11.694528 20894 util.go:451] The following files, go.mod, go.sum, were changed! exec: go "install" "-mod=mod" "github.com/onsi/ginkgo/v2/ginkgo" go: downloading github.com/google/pprof v0.0.0-20260115054156-294ebfa9ad83 go: downloading github.com/go-task/slim-sprig/v3 v3.0.0 I0123 21:37:14.591223 20894 install.go:188] cloning 'https://github.com/redhat-appstudio/infra-deployments' with git ref 'refs/heads/main' Enumerating objects: 72711, done. Counting objects: 0% (1/144) Counting objects: 1% (2/144) Counting objects: 2% (3/144) Counting objects: 3% (5/144) Counting objects: 4% (6/144) Counting objects: 5% (8/144) Counting objects: 6% (9/144) Counting objects: 7% (11/144) Counting objects: 8% (12/144) Counting objects: 9% (13/144) Counting objects: 10% (15/144) Counting objects: 11% (16/144) Counting objects: 12% (18/144) Counting objects: 13% (19/144) Counting objects: 14% (21/144) Counting objects: 15% (22/144) Counting objects: 16% (24/144) Counting objects: 17% (25/144) Counting objects: 18% (26/144) Counting objects: 19% (28/144) Counting objects: 20% (29/144) Counting objects: 21% (31/144) Counting objects: 22% (32/144) Counting objects: 23% (34/144) Counting objects: 24% (35/144) Counting objects: 25% (36/144) Counting objects: 26% (38/144) Counting objects: 27% (39/144) Counting objects: 28% (41/144) Counting objects: 29% (42/144) Counting objects: 30% (44/144) Counting objects: 31% (45/144) Counting objects: 32% (47/144) Counting objects: 33% (48/144) Counting objects: 34% (49/144) Counting objects: 35% (51/144) Counting objects: 36% (52/144) Counting objects: 37% (54/144) Counting objects: 38% (55/144) Counting objects: 39% (57/144) Counting objects: 40% (58/144) Counting objects: 41% (60/144) Counting objects: 42% (61/144) Counting objects: 43% (62/144) Counting objects: 44% (64/144) Counting objects: 45% (65/144) Counting objects: 46% (67/144) Counting objects: 47% (68/144) Counting objects: 48% (70/144) Counting objects: 49% (71/144) Counting objects: 50% (72/144) Counting objects: 51% (74/144) Counting objects: 52% (75/144) Counting objects: 53% (77/144) Counting objects: 54% (78/144) Counting objects: 55% (80/144) Counting objects: 56% (81/144) Counting objects: 57% (83/144) Counting objects: 58% (84/144) Counting objects: 59% (85/144) Counting objects: 60% (87/144) Counting objects: 61% (88/144) Counting objects: 62% (90/144) Counting objects: 63% (91/144) Counting objects: 64% (93/144) Counting objects: 65% (94/144) Counting objects: 66% (96/144) Counting objects: 67% (97/144) Counting objects: 68% (98/144) Counting objects: 69% (100/144) Counting objects: 70% (101/144) Counting objects: 71% (103/144) Counting objects: 72% (104/144) Counting objects: 73% (106/144) Counting objects: 74% (107/144) Counting objects: 75% (108/144) Counting objects: 76% (110/144) Counting objects: 77% (111/144) Counting objects: 78% (113/144) Counting objects: 79% (114/144) Counting objects: 80% (116/144) Counting objects: 81% (117/144) Counting objects: 82% (119/144) Counting objects: 83% (120/144) Counting objects: 84% (121/144) Counting objects: 85% (123/144) Counting objects: 86% (124/144) Counting objects: 87% (126/144) Counting objects: 88% (127/144) Counting objects: 89% (129/144) Counting objects: 90% (130/144) Counting objects: 91% (132/144) Counting objects: 92% (133/144) Counting objects: 93% (134/144) Counting objects: 94% (136/144) Counting objects: 95% (137/144) Counting objects: 96% (139/144) Counting objects: 97% (140/144) Counting objects: 98% (142/144) Counting objects: 99% (143/144) Counting objects: 100% (144/144) Counting objects: 100% (144/144), done. Compressing objects: 1% (1/91) Compressing objects: 2% (2/91) Compressing objects: 3% (3/91) Compressing objects: 4% (4/91) Compressing objects: 5% (5/91) Compressing objects: 6% (6/91) Compressing objects: 7% (7/91) Compressing objects: 8% (8/91) Compressing objects: 9% (9/91) Compressing objects: 10% (10/91) Compressing objects: 12% (11/91) Compressing objects: 13% (12/91) Compressing objects: 14% (13/91) Compressing objects: 15% (14/91) Compressing objects: 16% (15/91) Compressing objects: 17% (16/91) Compressing objects: 18% (17/91) Compressing objects: 19% (18/91) Compressing objects: 20% (19/91) Compressing objects: 21% (20/91) Compressing objects: 23% (21/91) Compressing objects: 24% (22/91) Compressing objects: 25% (23/91) Compressing objects: 26% (24/91) Compressing objects: 27% (25/91) Compressing objects: 28% (26/91) Compressing objects: 29% (27/91) Compressing objects: 30% (28/91) Compressing objects: 31% (29/91) Compressing objects: 32% (30/91) Compressing objects: 34% (31/91) Compressing objects: 35% (32/91) Compressing objects: 36% (33/91) Compressing objects: 37% (34/91) Compressing objects: 38% (35/91) Compressing objects: 39% (36/91) Compressing objects: 40% (37/91) Compressing objects: 41% (38/91) Compressing objects: 42% (39/91) Compressing objects: 43% (40/91) Compressing objects: 45% (41/91) Compressing objects: 46% (42/91) Compressing objects: 47% (43/91) Compressing objects: 48% (44/91) Compressing objects: 49% (45/91) Compressing objects: 50% (46/91) Compressing objects: 51% (47/91) Compressing objects: 52% (48/91) Compressing objects: 53% (49/91) Compressing objects: 54% (50/91) Compressing objects: 56% (51/91) Compressing objects: 57% (52/91) Compressing objects: 58% (53/91) Compressing objects: 59% (54/91) Compressing objects: 60% (55/91) Compressing objects: 61% (56/91) Compressing objects: 62% (57/91) Compressing objects: 63% (58/91) Compressing objects: 64% (59/91) Compressing objects: 65% (60/91) Compressing objects: 67% (61/91) Compressing objects: 68% (62/91) Compressing objects: 69% (63/91) Compressing objects: 70% (64/91) Compressing objects: 71% (65/91) Compressing objects: 72% (66/91) Compressing objects: 73% (67/91) Compressing objects: 74% (68/91) Compressing objects: 75% (69/91) Compressing objects: 76% (70/91) Compressing objects: 78% (71/91) Compressing objects: 79% (72/91) Compressing objects: 80% (73/91) Compressing objects: 81% (74/91) Compressing objects: 82% (75/91) Compressing objects: 83% (76/91) Compressing objects: 84% (77/91) Compressing objects: 85% (78/91) Compressing objects: 86% (79/91) Compressing objects: 87% (80/91) Compressing objects: 89% (81/91) Compressing objects: 90% (82/91) Compressing objects: 91% (83/91) Compressing objects: 92% (84/91) Compressing objects: 93% (85/91) Compressing objects: 94% (86/91) Compressing objects: 95% (87/91) Compressing objects: 96% (88/91) Compressing objects: 97% (89/91) Compressing objects: 98% (90/91) Compressing objects: 100% (91/91) Compressing objects: 100% (91/91), done. Total 72711 (delta 89), reused 58 (delta 53), pack-reused 72567 (from 4) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. Installing the OpenShift GitOps operator subscription: clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created subscription.operators.coreos.com/openshift-gitops-operator created Waiting for default project (and namespace) to exist: ..................................OK Waiting for OpenShift GitOps Route: OK argocd.argoproj.io/openshift-gitops patched argocd.argoproj.io/openshift-gitops patched Switch the Route to use re-encryption argocd.argoproj.io/openshift-gitops patched Restarting ArgoCD Server pod "openshift-gitops-server-78868c5878-b7kmx" deleted Allow any authenticated users to be admin on the Argo CD instance argocd.argoproj.io/openshift-gitops patched Mark Pending PVC as Healthy, workaround for WaitForFirstConsumer StorageClasses. Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) Setting kustomize build options argocd.argoproj.io/openshift-gitops patched Setting ignore Aggregated Roles argocd.argoproj.io/openshift-gitops patched Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched Restarting GitOps server deployment.apps/openshift-gitops-server restarted ========================================================================= Argo CD URL is: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-e0c25f6715.sjlh.p3.openshiftapps.com (NOTE: It may take a few moments for the route to become available) Waiting for the route: ..........OK Login/password uses your OpenShift credentials ('Login with OpenShift' button) Setting secrets for Quality Dashboard namespace/quality-dashboard created secret/quality-dashboard-secrets created Creating secret for CI Helper App namespace/ci-helper-app created secret/ci-helper-app-secrets created Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation namespace/product-kubearchive-logging created Creating DB secret secret/tekton-results-database created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config secret/minio-storage-configuration created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config MinIO config already exists, skipping creation Creating Postgres TLS certs .....+..+............+...+...+......................+...+..+.+.....+.+........+...+.......+...+..+...+.........+.............+++++++++++++++++++++++++++++++++++++++*........+.....+.......+.........+......+++++++++++++++++++++++++++++++++++++++*.....+..+...+............+...+.+...+...........+.........+...+....+..............+.+...+..+.+..............+.+...+..+.......+.....+......+....+.................+.+...............+..+.......+.....+......+.........+................+..+.+......+...+.....+......+.+...+...+...+..+...+....+..+....+.....+......+.........+.+...+........+.........+....+............+..+............+.............+.....+.+....................+..........+..+...+.+.....+.+...............+........+......+.............+......+..+...+.+........+.+..+.......+...+..+......+.......+...+..+...+.......+..+.......+..........................+.........+...+...+...+.+......+........+.+.........+......+.....+................+.....+....+.........+..+...................+...+.....+......+.+......+.....+............+............+....+......+...+..+...+..........+...............+.....+..........+........+....+...........+....+...+...+...+...........+.+........+.+...+..+.+.....+...+......+....+..+.............+..+.......+..+......+...+.+......+..+......+.......+.................+......+.+...........+....+..............+.......+..............+...+......+.........+.+..+.........+..........+........+.......+...........+.......+........+.........++++++ ..+..+......+.......+..+.+.....+.......+...+..+............+.........+.+......+...+..+....+......+...+...........+.+..+.+++++++++++++++++++++++++++++++++++++++*...+...+............+..+................+.........+.....+++++++++++++++++++++++++++++++++++++++*........................+...+...+.....+.......+..+.+..+......+.+.........+..+...+.+........+..........+...+..............+.+..+................+............+...+...............+............+........+.+...+..+.............+..+......+..........+............+........+.......+...+..+.+..+...+.+...+...........+.+.....+...+.+..+.......++++++ ----- Certificate request self-signature ok subject=CN=cluster.local ...+...+..........+...+.....+..........+...........+......+....+...+.....+..........+......+++++++++++++++++++++++++++++++++++++++*............+...+..........+.....+..........+........+.........+...+.+..+....+++++++++++++++++++++++++++++++++++++++*.+...+.+..................+.................+...+.+.........+..+...+.......+...+........+..........+........+......+.+.....+.......+........+....+......+...+..+.......+...+...+.........+..+...+.+............+..+..........+...+.........+.....+...+.+..+...+............+...+...............+....+...+...+...........+....+..+.......+............+...+..+..................+.+.........+.....+...+..........+...+.........+..+......+....+...............+........+.......+...............+........++++++ ..+.+...+..+...+.......+..+...............+.......+........+.+......+......+++++++++++++++++++++++++++++++++++++++*.......+.......+...+..+....+.....+...+......+.+++++++++++++++++++++++++++++++++++++++*..+..+...+...+....+.....+..................+...+............+...+..........+..+...+...+......+...................+.........+...........+.+...+..+.+..............+.+.........+........+.+..............+...+....+...+..+.........+...............+.+...+...+........+....+..+......+...+............+....+.........+..+...+.......+.........+......+..+.............+...+......+...+.....+...+...+.+...+........+...+....+.....+.......+...+........+....+...+......+..+.........+....+...........+..........+...+..+......+.......+..+....+...............+......+.....+...+..........+...+..+...............+.+...........+......+.......+..+.+.....+...............+.............+......+.........+..+.......+...............+......+.....+......+.+..+.............+.....+.......+...+...+..+...+..........+.........+.....++++++ ----- Certificate request self-signature ok subject=CN=postgres-postgresql.tekton-results.svc.cluster.local secret/postgresql-tls created configmap/rds-root-crt created namespace/application-service created Creating a has secret from legacy token secret/has-github-token created Creating a secret with a token for Image Controller namespace/image-controller created secret/quaytoken created Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.yRZ2TDqiCt secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.yRZ2TDqiCt secret/docker-io-pull created Setting secrets for Dora metrics exporter namespace/dora-metrics created secret/exporters-secret created Setting Cluster Mode: preview Switched to a new branch 'preview-main-itix' labeling node/ip-10-0-137-33.ec2.internal... node/ip-10-0-137-33.ec2.internal labeled successfully labeled node/ip-10-0-137-33.ec2.internal labeling node/ip-10-0-156-175.ec2.internal... node/ip-10-0-156-175.ec2.internal labeled successfully labeled node/ip-10-0-156-175.ec2.internal labeling node/ip-10-0-168-238.ec2.internal... node/ip-10-0-168-238.ec2.internal labeled successfully labeled node/ip-10-0-168-238.ec2.internal verifying labels... all nodes labeled successfully. Detected OCP minor version: 17 Changing AppStudio Gitlab Org to "redhat-appstudio-qe" [preview-main-itix 5ed5d2fa5] Preview mode, do not merge into main 6 files changed, 12 insertions(+), 18 deletions(-) remote: remote: Create a pull request for 'preview-main-itix' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-itix remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-itix -> preview-main-itix branch 'preview-main-itix' set up to track 'qe/preview-main-itix'. application.argoproj.io/all-application-sets created Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/dora-metrics-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/monitoring-registry-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched application.argoproj.io/monitoring-workload-grafana-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/image-rbac-proxy-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/has-in-cluster-local patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) All Applications are synced and Healthy All required tekton resources are installed and ready Tekton CRDs are ready Setup Pac with existing QE sprayproxy and github App namespace/openshift-pipelines configured namespace/build-service configured namespace/integration-service configured secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created Configured pipelines-as-code-secret secret in openshift-pipelines namespace Switched to branch 'main' Your branch is up to date with 'upstream/main'. [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 101 [running]: > runtime/debug.Stack() > /usr/lib/golang/src/runtime/debug/stack.go:26 +0x5e > sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot() > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/log/log.go:60 +0xcd > sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0xc00031b200, {0x372fb79, 0x14}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/log/deleg.go:147 +0x3e > github.com/go-logr/logr.Logger.WithName({{0x3fa6a60, 0xc00031b200}, 0x0}, {0x372fb79?, 0x0?}) > /opt/app-root/src/go/pkg/mod/github.com/go-logr/logr@v1.4.3/logr.go:345 +0x36 > sigs.k8s.io/controller-runtime/pkg/client.newClient(0x1?, {0x0, 0xc0008e0f50, {0x0, 0x0}, 0x0, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/client/client.go:118 +0xdb > sigs.k8s.io/controller-runtime/pkg/client.New(0xc000a5e008?, {0x0, 0xc0008e0f50, {0x0, 0x0}, 0x0, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/client/client.go:98 +0x4d > github.com/konflux-ci/e2e-tests/pkg/clients/kubernetes.NewAdminKubernetesClient() > /tmp/tmp.exoENGkbmk/pkg/clients/kubernetes/client.go:157 +0x8f > github.com/konflux-ci/e2e-tests/pkg/clients/sprayproxy.GetPaCHost() > /tmp/tmp.exoENGkbmk/pkg/clients/sprayproxy/sprayproxy.go:93 +0x1c > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.registerPacServer() > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/repos/common.go:426 +0x78 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.init.func8(0xc0008fc508?) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/repos/common.go:378 +0x25 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.ActionFunc.Execute(0xc?, 0x3707561?) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/types.go:279 +0x19 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Apply(...) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/types.go:315 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x60ddc20, 0xc0008fc508) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/types.go:348 +0xb3 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x60d5b20?, 0xc00164fbd8?, 0x2413659?}, 0xc0008fc508) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x60ddce0, 0xc0008fc508) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/types.go:340 +0x2b > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x60df960?, 0x1a0?, 0x0?}, 0xc0008fc508) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).runLoadedCatalog(0x61163e8, {0xc0006e5688?, 0xc001473e60?, 0x47?}, 0xc0008fc508) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/types.go:129 +0x11f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).RunRulesOfCategory(0x61163e8, {0x3701582, 0x2}, 0xc0008fc508) > /tmp/tmp.exoENGkbmk/magefiles/rulesengine/types.go:121 +0x1b4 > main.CI.TestE2E({}) > /tmp/tmp.exoENGkbmk/magefiles/magefile.go:330 +0x18a > main.main.func19({0xc000003dc0?, 0xc0000a8008?}) > /tmp/tmp.exoENGkbmk/magefiles/mage_output_file.go:838 +0xf > main.main.func12.1() > /tmp/tmp.exoENGkbmk/magefiles/mage_output_file.go:303 +0x5b > created by main.main.func12 in goroutine 1 > /tmp/tmp.exoENGkbmk/magefiles/mage_output_file.go:298 +0xbe I0123 21:48:44.741226 20894 common.go:434] Registered PaC server: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-e0c25f6715.sjlh.p3.openshiftapps.com I0123 21:48:44.804937 20894 common.go:459] The PaC servers registered in Sprayproxy: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-a97f1fd776.d6ou.p3.openshiftapps.com, https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-e0c25f6715.sjlh.p3.openshiftapps.com I0123 21:48:44.804955 20894 common.go:475] going to create new Tekton bundle remote-build for the purpose of testing multi-platform-controller PR I0123 21:48:45.143174 20894 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.7@sha256:97b646590d8863a029c4105ed78391b7b2f378277da256b42c59a477fa87fca0 I0123 21:48:45.145493 20894 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204924-tdqf -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0123 21:48:46.284110 20894 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204924-tdqf: quay.io/redhat-appstudio-qe/test-images@sha256:571848856c82c24a5f9da336fc2894a856961b9c3d7eea9c859d68fbfb22078c I0123 21:48:46.284175 20894 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_ARM64 to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204924-tdqf I0123 21:48:46.485809 20894 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.7@sha256:97b646590d8863a029c4105ed78391b7b2f378277da256b42c59a477fa87fca0 I0123 21:48:46.487843 20894 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204926-iuzr -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0123 21:48:47.558860 20894 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204926-iuzr: quay.io/redhat-appstudio-qe/test-images@sha256:535ff36f139493d57fd1dae4365c73dec34c0e672cf2e30f74f941c142dcba4e I0123 21:48:47.558884 20894 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_S390X to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204926-iuzr I0123 21:48:47.826868 20894 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.7@sha256:97b646590d8863a029c4105ed78391b7b2f378277da256b42c59a477fa87fca0 I0123 21:48:47.828872 20894 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204927-tbll -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0123 21:48:48.902081 20894 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204927-tbll: quay.io/redhat-appstudio-qe/test-images@sha256:1cbc2cfa0a1fa6a1d68ba239962952fbfe5dfa0ebbc3bbf1fe3c9bf08608810e I0123 21:48:48.902102 20894 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_PPC64LE to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1769204927-tbll exec: ginkgo "--seed=1769204230" "--timeout=1h30m0s" "--grace-period=30s" "--output-interceptor-mode=none" "--no-color" "--json-report=e2e-report.json" "--junit-report=e2e-report.xml" "--procs=20" "--nodes=20" "--p" "--output-dir=/workspace/artifact-dir" "./cmd" "--" go: downloading github.com/konflux-ci/build-service v0.0.0-20240611083846-2dee6cfe6fe4 go: downloading github.com/IBM/go-sdk-core/v5 v5.15.3 go: downloading github.com/IBM/vpc-go-sdk v0.48.0 go: downloading github.com/aws/aws-sdk-go-v2 v1.38.1 go: downloading github.com/aws/aws-sdk-go-v2/config v1.31.3 go: downloading github.com/aws/aws-sdk-go-v2/service/ec2 v1.135.0 go: downloading github.com/google/go-github/v45 v45.2.0 go: downloading github.com/go-openapi/strfmt v0.23.0 go: downloading github.com/go-playground/validator/v10 v10.17.0 go: downloading go.mongodb.org/mongo-driver v1.17.4 go: downloading github.com/mitchellh/mapstructure v1.5.1-0.20231216201459-8508981c8b6c go: downloading github.com/asaskevich/govalidator v0.0.0-20230301143203-a9d515a09cc2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/go-openapi/errors v0.22.2 go: downloading github.com/leodido/go-urn v1.3.0 go: downloading github.com/gabriel-vasile/mimetype v1.4.3 go: downloading github.com/go-playground/universal-translator v0.18.1 go: downloading github.com/aws/smithy-go v1.22.5 go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.18.7 go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.18.4 go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.28.2 go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3 go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.34.0 go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.38.0 go: downloading github.com/go-playground/locales v0.14.1 go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.4.4 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.13.0 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.13.4 go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.7.4 Running Suite: Red Hat App Studio E2E tests - /tmp/tmp.exoENGkbmk/cmd ===================================================================== Random Seed: 1769204230 Will run 201 of 275 specs Running in parallel across 20 processes ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies if release CR is created [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_advisories.go:117 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies the advs release pipelinerun is running and succeeds [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_advisories.go:127 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_advisories.go:157 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies if the repository URL is valid [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_advisories.go:168 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification tests that Release CR is created for the Snapshot [release-pipelines, rh-push-to-external-registry] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_push_to_external_registry.go:215 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification verifies a release PipelineRun is started and succeeded in managed namespace [release-pipelines, rh-push-to-external-registry] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_push_to_external_registry.go:226 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification validate the result of task create-pyxis-image contains image ids [release-pipelines, rh-push-to-external-registry] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_push_to_external_registry.go:233 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification tests that Release CR has completed [release-pipelines, rh-push-to-external-registry] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_push_to_external_registry.go:248 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification validates that imageIds from task create-pyxis-image exist in Pyxis. [release-pipelines, rh-push-to-external-registry] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_push_to_external_registry.go:265 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies the release CR is created [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.exoENGkbmk/tests/release/pipelines/multiarch_advisories.go:112 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies the multiarch release pipelinerun is running and succeeds [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.exoENGkbmk/tests/release/pipelines/multiarch_advisories.go:122 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies if the release CR is created [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_push_to_registry_redhat_io.go:108 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.exoENGkbmk/tests/release/pipelines/multiarch_advisories.go:152 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies the rhio release pipelinerun is running and succeeds [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_push_to_registry_redhat_io.go:118 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies if the repository URL is valid [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.exoENGkbmk/tests/release/pipelines/multiarch_advisories.go:163 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_push_to_registry_redhat_io.go:148 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies if the MR URL is valid [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rh_push_to_registry_redhat_io.go:159 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if release CR is created [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.exoENGkbmk/tests/release/pipelines/release_to_github.go:138 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies the release pipelinerun is running and succeeds [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.exoENGkbmk/tests/release/pipelines/release_to_github.go:148 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.exoENGkbmk/tests/release/pipelines/release_to_github.go:181 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if the Release exists in github repo [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.exoENGkbmk/tests/release/pipelines/release_to_github.go:192 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:123 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:128 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:132 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:136 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:178 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:183 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:187 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:191 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies if the release CR is created [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rhtap_service_push.go:150 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies the rhtap release pipelinerun is running and succeeds [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rhtap_service_push.go:160 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:233 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:238 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rhtap_service_push.go:190 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context points to a file [build-templates] /tmp/tmp.exoENGkbmk/tests/build/tkn-bundle.go:188 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles from specific context [build-templates] /tmp/tmp.exoENGkbmk/tests/build/tkn-bundle.go:199 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies if the PR in infra-deployments repo is created/updated [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.exoENGkbmk/tests/release/pipelines/rhtap_service_push.go:200 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:242 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context is the root directory [build-templates] /tmp/tmp.exoENGkbmk/tests/build/tkn-bundle.go:209 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:246 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:286 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-host-pool] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:120 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when context points to a file and a directory [build-templates] /tmp/tmp.exoENGkbmk/tests/build/tkn-bundle.go:218 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-host-pool] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:124 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:291 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when using negation [build-templates] /tmp/tmp.exoENGkbmk/tests/build/tkn-bundle.go:228 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-host-pool] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:127 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:295 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding HOME environment variable [build-templates] /tmp/tmp.exoENGkbmk/tests/build/tkn-bundle.go:238 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.exoENGkbmk/tests/release/pipelines/fbc_release.go:299 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-host-pool] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:148 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding STEP image [build-templates] /tmp/tmp.exoENGkbmk/tests/build/tkn-bundle.go:247 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created test that cleanup happened successfully [multi-platform, aws-host-pool] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:152 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that a Release CR should have been created in the dev namespace [release-pipelines, push-to-external-registry] /tmp/tmp.exoENGkbmk/tests/release/pipelines/push_to_external_registry.go:157 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:251 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that Release PipelineRun should eventually succeed [release-pipelines, push-to-external-registry] /tmp/tmp.exoENGkbmk/tests/release/pipelines/push_to_external_registry.go:164 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:255 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:259 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:263 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, aws-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:267 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification tests if the image was pushed to quay [release-pipelines, push-to-external-registry] /tmp/tmp.exoENGkbmk/tests/release/pipelines/push_to_external_registry.go:168 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmz-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:341 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmz-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:345 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmz-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:349 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that a Release is marked as succeeded. [release-pipelines, push-to-external-registry] /tmp/tmp.exoENGkbmk/tests/release/pipelines/push_to_external_registry.go:175 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmz-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:353 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmz-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:357 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmp-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:432 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmp-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:436 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmp-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:440 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmp-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:444 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmp-dynamic] /tmp/tmp.exoENGkbmk/tests/build/multi-platform.go:448 ------------------------------ • ------------------------------ • [PANICKED] [49.055 seconds] [upgrade-suite Create users and check their state] [It] Verify AppStudioProvisionedUser [upgrade-verify] /tmp/tmp.exoENGkbmk/tests/upgrade/verifyWorkload.go:20 Timeline >> "msg"="Observed a panic" "error"=null "panic"="runtime error: invalid memory address or nil pointer dereference" "panicGoValue"="\"invalid memory address or nil pointer dereference\"" "stacktrace"="goroutine 194 [running]:\nk8s.io/apimachinery/pkg/util/runtime.logPanic({0x3f73880, 0xc001194030}, {0x31c4080, 0x5fb8b90})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:132 +0xbc\nk8s.io/apimachinery/pkg/util/runtime.handleCrash({0x3f73928, 0xc000926d20}, {0x31c4080, 0x5fb8b90}, {0x0, 0x0, 0x447080?})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:107 +0x116\nk8s.io/apimachinery/pkg/util/runtime.HandleCrashWithContext({0x3f73928, 0xc000926d20}, {0x0, 0x0, 0x0})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:78 +0x5a\npanic({0x31c4080?, 0x5fb8b90?})\n\t/usr/lib/golang/src/runtime/panic.go:783 +0x132\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp.func1()\n\t/tmp/tmp.exoENGkbmk/pkg/sandbox/sandbox.go:319 +0x35\ngithub.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval.func1({0xc000926e01?, 0xc00011dc18?})\n\t/tmp/tmp.exoENGkbmk/pkg/utils/util.go:129 +0x13\nk8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1({0x3f73928?, 0xc000926d20?}, 0x3f73928?)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:53 +0x62\nk8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext({0x3f73928, 0xc000926d20}, {0x3f60f90, 0xc000ab1600}, 0x1, 0x0, 0xc00011dd90)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:54 +0x115\nk8s.io/apimachinery/pkg/util/wait.PollUntilContextTimeout({0x3f737d8?, 0x6079740?}, 0xee6b2800, 0x41d745?, 0x1, 0xc00011dd90)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/poll.go:48 +0xa5\ngithub.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval(0xa?, 0xc00011ddd8?, 0x1?)\n\t/tmp/tmp.exoENGkbmk/pkg/utils/util.go:129 +0x45\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp(0x389fccd?, {0x389fccd?, 0x389c721?}, 0x8?)\n\t/tmp/tmp.exoENGkbmk/pkg/sandbox/sandbox.go:318 +0x72\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreated(0x0, {0x389fccd, 0x9})\n\t/tmp/tmp.exoENGkbmk/pkg/sandbox/sandbox.go:314 +0x4b\ngithub.com/konflux-ci/e2e-tests/tests/upgrade/verify.VerifyAppStudioProvisionedUser(0x63?)\n\t/tmp/tmp.exoENGkbmk/tests/upgrade/verify/verifyUsers.go:14 +0x25\ngithub.com/konflux-ci/e2e-tests/tests/upgrade.init.func1.2()\n\t/tmp/tmp.exoENGkbmk/tests/upgrade/verifyWorkload.go:21 +0x1a\ngithub.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0x414928?, 0xc000de7a98?})\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.27.5/internal/node.go:524 +0x13\ngithub.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.27.5/internal/suite.go:945 +0x393\ncreated by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 37\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.27.5/internal/suite.go:910 +0xd50\n" [PANICKED] in [It] - /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 @ 01/23/26 21:51:35.582 << Timeline [PANICKED] Test Panicked In [It] at: /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 @ 01/23/26 21:51:35.582 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/apimachinery/pkg/util/runtime.handleCrash({0x3f73928, 0xc000926d20}, {0x31c4080, 0x5fb8b90}, {0x0, 0x0, 0x447080?}) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 +0x1a9 k8s.io/apimachinery/pkg/util/runtime.HandleCrashWithContext({0x3f73928, 0xc000926d20}, {0x0, 0x0, 0x0}) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:78 +0x5a panic({0x31c4080?, 0x5fb8b90?}) /usr/lib/golang/src/runtime/panic.go:783 +0x132 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp.func1() /tmp/tmp.exoENGkbmk/pkg/sandbox/sandbox.go:319 +0x35 github.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval.func1({0xc000926e01?, 0xc00011dc18?}) /tmp/tmp.exoENGkbmk/pkg/utils/util.go:129 +0x13 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1({0x3f73928?, 0xc000926d20?}, 0x3f73928?) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:53 +0x62 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext({0x3f73928, 0xc000926d20}, {0x3f60f90, 0xc000ab1600}, 0x1, 0x0, 0xc00164fd90) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:54 +0x115 k8s.io/apimachinery/pkg/util/wait.PollUntilContextTimeout({0x3f737d8?, 0x6079740?}, 0xee6b2800, 0x41d745?, 0x1, 0xc00011dd90) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/poll.go:48 +0xa5 github.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval(0xa?, 0xc00011ddd8?, 0x1?) /tmp/tmp.exoENGkbmk/pkg/utils/util.go:129 +0x45 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp(0x389fccd?, {0x389fccd?, 0x389c721?}, 0x8?) /tmp/tmp.exoENGkbmk/pkg/sandbox/sandbox.go:318 +0x72 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreated(0x0, {0x389fccd, 0x9}) /tmp/tmp.exoENGkbmk/pkg/sandbox/sandbox.go:314 +0x4b github.com/konflux-ci/e2e-tests/tests/upgrade/verify.VerifyAppStudioProvisionedUser(0x63?) /tmp/tmp.exoENGkbmk/tests/upgrade/verify/verifyUsers.go:14 +0x25 github.com/konflux-ci/e2e-tests/tests/upgrade.init.func1.2() /tmp/tmp.exoENGkbmk/tests/upgrade/verifyWorkload.go:21 +0x1a ------------------------------ SS••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••S•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.exoENGkbmk/tests/build/build_templates.go:489 ------------------------------ ••••••••••••••••S ------------------------------ • [FAILED] [26.442 seconds] [enterprise-contract-suite Conforma E2E tests] test creating and signing an image and task verify-enterprise-contract task Release Policy [It] verifies redhat products pass the redhat policy rule collection before release [ec, pipeline] /tmp/tmp.exoENGkbmk/tests/enterprise-contract/contract.go:347 Timeline >> Update public key to verify golden images Creating Pipeline "verify-enterprise-contract-run-q7ffg" Waiting for pipeline "verify-enterprise-contract-run-q7ffg" to finish [FAILED] in [It] - /tmp/tmp.exoENGkbmk/tests/enterprise-contract/contract.go:380 @ 01/23/26 22:01:07.396 << Timeline [FAILED] Expected <[]v1.TaskRunResult | len:1, cap:1>: [ { Name: "TEST_OUTPUT", Type: "string", Value: { Type: "string", StringVal: "{\"timestamp\":\"1769205665\",\"namespace\":\"\",\"successes\":360,\"failures\":6,\"warnings\":18,\"result\":\"FAILURE\"}\n", ArrayVal: nil, ObjectVal: nil, }, }, ] not to contain elements <[]*tekton.TaskRunResultMatcher | len:1, cap:1>: [ { name: "TEST_OUTPUT", jsonPath: "{$.result}", value: nil, jsonValue: "[\"FAILURE\"]", jsonMatcher: <*matchers.MatchJSONMatcher | 0xc00148da70>{ JSONToMatch: "[\"FAILURE\"]", firstFailurePath: nil, }, }, ] In [It] at: /tmp/tmp.exoENGkbmk/tests/enterprise-contract/contract.go:380 @ 01/23/26 22:01:07.396 ------------------------------ SS•••••••••••••••••••••••••••••••••S•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build-oci-ta should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.exoENGkbmk/tests/build/build_templates.go:489 ------------------------------ •••S••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• ------------------------------ • [FAILED] [902.395 seconds] [integration-service-suite Creation of group snapshots for monorepo and multiple repos] with status reporting of Integration tests in CheckRuns when IntegrationTestScenario reference to task as pipelinerun resolution [It] trigger pipelinerun for invalid integrationTestScenario by annotating snapshot and verify failing to create integration pipelinerun [integration-service, group-snapshot-creation] /tmp/tmp.exoENGkbmk/tests/integration-service/group-snapshots-tests.go:730 [FAILED] Timed out after 900.000s. timeout while waiting for group snapshot and failing integration pipelinerun with invalid resolution Expected success, but got an error: <*errors.errorString | 0xc0005ca080>: failing to find the integration test status detail group-xswv/integ-app-ydit-20260123-221543-900 for invalid resolution { s: "failing to find the integration test status detail group-xswv/integ-app-ydit-20260123-221543-900 for invalid resolution", } In [It] at: /tmp/tmp.exoENGkbmk/tests/integration-service/group-snapshots-tests.go:753 @ 01/23/26 22:30:55.746 ------------------------------ Summarizing 3 Failures: [PANICKED!] [upgrade-suite Create users and check their state] [It] Verify AppStudioProvisionedUser [upgrade-verify] /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 [FAIL] [enterprise-contract-suite Conforma E2E tests] test creating and signing an image and task verify-enterprise-contract task Release Policy [It] verifies redhat products pass the redhat policy rule collection before release [ec, pipeline] /tmp/tmp.exoENGkbmk/tests/enterprise-contract/contract.go:380 [FAIL] [integration-service-suite Creation of group snapshots for monorepo and multiple repos] with status reporting of Integration tests in CheckRuns when IntegrationTestScenario reference to task as pipelinerun resolution [It] trigger pipelinerun for invalid integrationTestScenario by annotating snapshot and verify failing to create integration pipelinerun [integration-service, group-snapshot-creation] /tmp/tmp.exoENGkbmk/tests/integration-service/group-snapshots-tests.go:753 Ran 191 of 275 Specs in 2411.857 seconds FAIL! -- 188 Passed | 3 Failed | 74 Pending | 10 Skipped Ginkgo ran 1 suite in 42m9.302957856s Test Suite Failed Error: running "ginkgo --seed=1769204230 --timeout=1h30m0s --grace-period=30s --output-interceptor-mode=none --no-color --json-report=e2e-report.json --junit-report=e2e-report.xml --procs=20 --nodes=20 --p --output-dir=/workspace/artifact-dir ./cmd --" failed with exit code 1 make: *** [Makefile:25: ci/test/e2e] Error 1