./mage -v ci:teste2e go: downloading github.com/openshift/api v0.0.0-20260211200342-8ef4bf7dc587 Running target: CI:TestE2E I0212 01:46:18.947802 19971 magefile.go:529] setting up new custom bundle for testing... I0212 01:46:19.336021 19971 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770860779-xytd -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: docker-build to image I0212 01:46:20.437609 19971 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770860779-xytd: quay.io/redhat-appstudio-qe/test-images@sha256:c68e814291f50ab50e028e5eb84cf340fdb6c6fdbaf5bfb9bf1465d98f26e423 I0212 01:46:20.437657 19971 magefile.go:535] To use the custom docker bundle locally, run below cmd: export CUSTOM_DOCKER_BUILD_PIPELINE_BUNDLE=quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770860779-xytd I0212 01:46:20.437688 19971 e2e_repo.go:347] checking if repository is e2e-tests I0212 01:46:20.437698 19971 e2e_repo.go:335] multi-platform tests and require sprayproxy registering are set to TRUE exec: git "diff" "--name-status" "upstream/main..HEAD" I0212 01:46:20.440849 19971 util.go:451] The following files, go.mod, go.sum, were changed! exec: go "install" "-mod=mod" "github.com/onsi/ginkgo/v2/ginkgo" go: downloading github.com/go-task/slim-sprig/v3 v3.0.0 go: downloading github.com/google/pprof v0.0.0-20260106004452-d7df1bf2cac7 I0212 01:46:24.369391 19971 install.go:188] cloning 'https://github.com/redhat-appstudio/infra-deployments' with git ref 'refs/heads/main' Enumerating objects: 74041, done. Counting objects: 0% (1/164) Counting objects: 1% (2/164) Counting objects: 2% (4/164) Counting objects: 3% (5/164) Counting objects: 4% (7/164) Counting objects: 5% (9/164) Counting objects: 6% (10/164) Counting objects: 7% (12/164) Counting objects: 8% (14/164) Counting objects: 9% (15/164) Counting objects: 10% (17/164) Counting objects: 11% (19/164) Counting objects: 12% (20/164) Counting objects: 13% (22/164) Counting objects: 14% (23/164) Counting objects: 15% (25/164) Counting objects: 16% (27/164) Counting objects: 17% (28/164) Counting objects: 18% (30/164) Counting objects: 19% (32/164) Counting objects: 20% (33/164) Counting objects: 21% (35/164) Counting objects: 22% (37/164) Counting objects: 23% (38/164) Counting objects: 24% (40/164) Counting objects: 25% (41/164) Counting objects: 26% (43/164) Counting objects: 27% (45/164) Counting objects: 28% (46/164) Counting objects: 29% (48/164) Counting objects: 30% (50/164) Counting objects: 31% (51/164) Counting objects: 32% (53/164) Counting objects: 33% (55/164) Counting objects: 34% (56/164) Counting objects: 35% (58/164) Counting objects: 36% (60/164) Counting objects: 37% (61/164) Counting objects: 38% (63/164) Counting objects: 39% (64/164) Counting objects: 40% (66/164) Counting objects: 41% (68/164) Counting objects: 42% (69/164) Counting objects: 43% (71/164) Counting objects: 44% (73/164) Counting objects: 45% (74/164) Counting objects: 46% (76/164) Counting objects: 47% (78/164) Counting objects: 48% (79/164) Counting objects: 49% (81/164) Counting objects: 50% (82/164) Counting objects: 51% (84/164) Counting objects: 52% (86/164) Counting objects: 53% (87/164) Counting objects: 54% (89/164) Counting objects: 55% (91/164) Counting objects: 56% (92/164) Counting objects: 57% (94/164) Counting objects: 58% (96/164) Counting objects: 59% (97/164) Counting objects: 60% (99/164) Counting objects: 61% (101/164) Counting objects: 62% (102/164) Counting objects: 63% (104/164) Counting objects: 64% (105/164) Counting objects: 65% (107/164) Counting objects: 66% (109/164) Counting objects: 67% (110/164) Counting objects: 68% (112/164) Counting objects: 69% (114/164) Counting objects: 70% (115/164) Counting objects: 71% (117/164) Counting objects: 72% (119/164) Counting objects: 73% (120/164) Counting objects: 74% (122/164) Counting objects: 75% (123/164) Counting objects: 76% (125/164) Counting objects: 77% (127/164) Counting objects: 78% (128/164) Counting objects: 79% (130/164) Counting objects: 80% (132/164) Counting objects: 81% (133/164) Counting objects: 82% (135/164) Counting objects: 83% (137/164) Counting objects: 84% (138/164) Counting objects: 85% (140/164) Counting objects: 86% (142/164) Counting objects: 87% (143/164) Counting objects: 88% (145/164) Counting objects: 89% (146/164) Counting objects: 90% (148/164) Counting objects: 91% (150/164) Counting objects: 92% (151/164) Counting objects: 93% (153/164) Counting objects: 94% (155/164) Counting objects: 95% (156/164) Counting objects: 96% (158/164) Counting objects: 97% (160/164) Counting objects: 98% (161/164) Counting objects: 99% (163/164) Counting objects: 100% (164/164) Counting objects: 100% (164/164), done. Compressing objects: 0% (1/118) Compressing objects: 1% (2/118) Compressing objects: 2% (3/118) Compressing objects: 3% (4/118) Compressing objects: 4% (5/118) Compressing objects: 5% (6/118) Compressing objects: 6% (8/118) Compressing objects: 7% (9/118) Compressing objects: 8% (10/118) Compressing objects: 9% (11/118) Compressing objects: 10% (12/118) Compressing objects: 11% (13/118) Compressing objects: 12% (15/118) Compressing objects: 13% (16/118) Compressing objects: 14% (17/118) Compressing objects: 15% (18/118) Compressing objects: 16% (19/118) Compressing objects: 17% (21/118) Compressing objects: 18% (22/118) Compressing objects: 19% (23/118) Compressing objects: 20% (24/118) Compressing objects: 21% (25/118) Compressing objects: 22% (26/118) Compressing objects: 23% (28/118) Compressing objects: 24% (29/118) Compressing objects: 25% (30/118) Compressing objects: 26% (31/118) Compressing objects: 27% (32/118) Compressing objects: 28% (34/118) Compressing objects: 29% (35/118) Compressing objects: 30% (36/118) Compressing objects: 31% (37/118) Compressing objects: 32% (38/118) Compressing objects: 33% (39/118) Compressing objects: 34% (41/118) Compressing objects: 35% (42/118) Compressing objects: 36% (43/118) Compressing objects: 37% (44/118) Compressing objects: 38% (45/118) Compressing objects: 39% (47/118) Compressing objects: 40% (48/118) Compressing objects: 41% (49/118) Compressing objects: 42% (50/118) Compressing objects: 43% (51/118) Compressing objects: 44% (52/118) Compressing objects: 45% (54/118) Compressing objects: 46% (55/118) Compressing objects: 47% (56/118) Compressing objects: 48% (57/118) Compressing objects: 49% (58/118) Compressing objects: 50% (59/118) Compressing objects: 51% (61/118) Compressing objects: 52% (62/118) Compressing objects: 53% (63/118) Compressing objects: 54% (64/118) Compressing objects: 55% (65/118) Compressing objects: 56% (67/118) Compressing objects: 57% (68/118) Compressing objects: 58% (69/118) Compressing objects: 59% (70/118) Compressing objects: 60% (71/118) Compressing objects: 61% (72/118) Compressing objects: 62% (74/118) Compressing objects: 63% (75/118) Compressing objects: 64% (76/118) Compressing objects: 65% (77/118) Compressing objects: 66% (78/118) Compressing objects: 67% (80/118) Compressing objects: 68% (81/118) Compressing objects: 69% (82/118) Compressing objects: 70% (83/118) Compressing objects: 71% (84/118) Compressing objects: 72% (85/118) Compressing objects: 73% (87/118) Compressing objects: 74% (88/118) Compressing objects: 75% (89/118) Compressing objects: 76% (90/118) Compressing objects: 77% (91/118) Compressing objects: 78% (93/118) Compressing objects: 79% (94/118) Compressing objects: 80% (95/118) Compressing objects: 81% (96/118) Compressing objects: 82% (97/118) Compressing objects: 83% (98/118) Compressing objects: 84% (100/118) Compressing objects: 85% (101/118) Compressing objects: 86% (102/118) Compressing objects: 87% (103/118) Compressing objects: 88% (104/118) Compressing objects: 89% (106/118) Compressing objects: 90% (107/118) Compressing objects: 91% (108/118) Compressing objects: 92% (109/118) Compressing objects: 93% (110/118) Compressing objects: 94% (111/118) Compressing objects: 95% (113/118) Compressing objects: 96% (114/118) Compressing objects: 97% (115/118) Compressing objects: 98% (116/118) Compressing objects: 99% (117/118) Compressing objects: 100% (118/118) Compressing objects: 100% (118/118), done. Total 74041 (delta 95), reused 47 (delta 46), pack-reused 73877 (from 3) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. Installing the OpenShift GitOps operator subscription: clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created subscription.operators.coreos.com/openshift-gitops-operator created Waiting for default project (and namespace) to exist: .....................................OK Waiting for OpenShift GitOps Route: OK argocd.argoproj.io/openshift-gitops patched argocd.argoproj.io/openshift-gitops patched Switch the Route to use re-encryption argocd.argoproj.io/openshift-gitops patched Restarting ArgoCD Server pod "openshift-gitops-server-78868c5878-6djzw" deleted Allow any authenticated users to be admin on the Argo CD instance argocd.argoproj.io/openshift-gitops patched Mark Pending PVC as Healthy, workaround for WaitForFirstConsumer StorageClasses. Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) Setting kustomize build options argocd.argoproj.io/openshift-gitops patched Setting ignore Aggregated Roles argocd.argoproj.io/openshift-gitops patched Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched Restarting GitOps server deployment.apps/openshift-gitops-server restarted ========================================================================= Argo CD URL is: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-602a2298ad.qj22.p3.openshiftapps.com (NOTE: It may take a few moments for the route to become available) Waiting for the route: ...........OK Login/password uses your OpenShift credentials ('Login with OpenShift' button) Setting secrets for Quality Dashboard namespace/quality-dashboard created secret/quality-dashboard-secrets created Creating secret for CI Helper App namespace/ci-helper-app created secret/ci-helper-app-secrets created Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation namespace/product-kubearchive-logging created Creating DB secret secret/tekton-results-database created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config secret/minio-storage-configuration created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config MinIO config already exists, skipping creation Creating Postgres TLS certs ........+...+++++++++++++++++++++++++++++++++++++++*.....+...+......+.+...+..+.+..+......+......+......+.......+............+...+..+++++++++++++++++++++++++++++++++++++++*....+.....+..........+......+.....+.......+...+..+......+.+.....+......+............+...+....+........+.....................+....+..+.+...+.....+......+.............+...+..+...+...+.+...++++++ ...+.....+...+.+........+......+.......+.........+++++++++++++++++++++++++++++++++++++++*........+.....+...+.+..+..................+.+.....+....+..+...+......+++++++++++++++++++++++++++++++++++++++*........+..+.+..+............+...+..........+...+..+.......+.....+.+......+.........+.....+................+...+......+.....+.+.....+.+..+............+......+...+.......+...+.....+....+..+...............+...+......+.+........+............+..........+........+.+......+...+..+.+........+.+............................................+.+.........+............+..+......+.........++++++ ----- Certificate request self-signature ok subject=CN=cluster.local .+.+......+..+.......+...+..+.+..+...+.........+.........+....+......+..+++++++++++++++++++++++++++++++++++++++*.........+............+.....+.........+....+...+++++++++++++++++++++++++++++++++++++++*...+..+....+...+.....+......+.+......+.........+......+..+......+.......+...+.....+................+...+..+......+............+...............+.+......+...........+.........+..........+.....+......+....+.....+...+.......+..............+....+......+.........+......+..+...+....+...+...+..+...+....+......+...........+.........+.......+..+...+.........+................+...+..+....+.....+...+.......+...+...+.....+.......+..+.........+.+......+..+.+......+...+...........+......+.........+.......+...+..............+.+.....+.........+.+.....+.+......+...+...........+.+.........+...+.....+...+...........................+..................+..........+.....+...+....+.................+....+.....+...............+.....................+...+.+..+............+..........+......+.....+.+.....+...+......+.+......+.....+....+...+........+...............+...+......+.+...+...........+...+...+..........+..+.+.........+..+....+.....+..........+............+..+...+...+.+.........+.....+....+...+.........+...+..+...+.........................+...+...+.................+..........+..+......+....+..+....+.........+......+...............+......+.........+.....+....+..+...+.............+.........+......+..+..........+...+.....+.........+.++++++ ..+.+...........+......+...+....+........+....+...+..+....+...........+......+++++++++++++++++++++++++++++++++++++++*...........+.+...+......+++++++++++++++++++++++++++++++++++++++*...........+.+..+...+............+.+.....+....+........+...+....+...+.........+....................+...+.......+...........+.........+.+...+.........+..+...+...+.............+......+...............+.....+.+........+.+......+..............+....+...........+.+...........................+...........+.........++++++ ----- Certificate request self-signature ok subject=CN=postgres-postgresql.tekton-results.svc.cluster.local secret/postgresql-tls created configmap/rds-root-crt created namespace/application-service created Creating a has secret from legacy token secret/has-github-token created Creating a secret with a token for Image Controller namespace/image-controller created secret/quaytoken created Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.DEiKGqWXLE secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.DEiKGqWXLE secret/docker-io-pull created Setting secrets for Dora metrics exporter namespace/dora-metrics created secret/exporters-secret created Setting Cluster Mode: preview Switched to a new branch 'preview-main-zats' labeling node/ip-10-0-140-23.ec2.internal... node/ip-10-0-140-23.ec2.internal labeled successfully labeled node/ip-10-0-140-23.ec2.internal labeling node/ip-10-0-144-51.ec2.internal... node/ip-10-0-144-51.ec2.internal labeled successfully labeled node/ip-10-0-144-51.ec2.internal labeling node/ip-10-0-164-25.ec2.internal... node/ip-10-0-164-25.ec2.internal labeled successfully labeled node/ip-10-0-164-25.ec2.internal verifying labels... all nodes labeled successfully. Detected OCP minor version: 17 Changing AppStudio Gitlab Org to "redhat-appstudio-qe" [preview-main-zats 0e44c46a2] Preview mode, do not merge into main 6 files changed, 12 insertions(+), 18 deletions(-) remote: remote: Create a pull request for 'preview-main-zats' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-zats remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-zats -> preview-main-zats branch 'preview-main-zats' set up to track 'qe/preview-main-zats'. application.argoproj.io/all-application-sets created Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/image-rbac-proxy-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/dora-metrics-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/monitoring-workload-grafana-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/monitoring-registry-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/has-in-cluster-local patched application-api-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local Synced Progressing Waiting 10 seconds for application sync All Applications are synced and Healthy All required tekton resources are installed and ready Tekton CRDs are ready Setup Pac with existing QE sprayproxy and github App namespace/openshift-pipelines configured namespace/build-service configured namespace/integration-service configured secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created Configured pipelines-as-code-secret secret in openshift-pipelines namespace Switched to branch 'main' Your branch is up to date with 'upstream/main'. [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 98 [running]: > runtime/debug.Stack() > /usr/lib/golang/src/runtime/debug/stack.go:26 +0x5e > sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot() > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/log/log.go:60 +0xcd > sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0xc000aaa640, {0x372ec05, 0x14}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/log/deleg.go:147 +0x3e > github.com/go-logr/logr.Logger.WithName({{0x3fa7b20, 0xc000aaa640}, 0x0}, {0x372ec05?, 0x0?}) > /opt/app-root/src/go/pkg/mod/github.com/go-logr/logr@v1.4.3/logr.go:345 +0x36 > sigs.k8s.io/controller-runtime/pkg/client.newClient(0x1?, {0x0, 0xc0008f44d0, {0x0, 0x0}, 0x0, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/client/client.go:118 +0xdb > sigs.k8s.io/controller-runtime/pkg/client.New(0xc000a2e008?, {0x0, 0xc0008f44d0, {0x0, 0x0}, 0x0, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.2/pkg/client/client.go:98 +0x4d > github.com/konflux-ci/e2e-tests/pkg/clients/kubernetes.NewAdminKubernetesClient() > /tmp/tmp.VcWBJKPJhc/pkg/clients/kubernetes/client.go:157 +0x8f > github.com/konflux-ci/e2e-tests/pkg/clients/sprayproxy.GetPaCHost() > /tmp/tmp.VcWBJKPJhc/pkg/clients/sprayproxy/sprayproxy.go:93 +0x1c > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.registerPacServer() > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/repos/common.go:426 +0x78 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.init.func8(0xc00099ea08?) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/repos/common.go:378 +0x25 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.ActionFunc.Execute(0xc?, 0x37065e1?) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/types.go:279 +0x19 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Apply(...) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/types.go:315 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x60dec00, 0xc00099ea08) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/types.go:348 +0xb3 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x60d6b00?, 0xc0010a5bd8?, 0x2416c19?}, 0xc00099ea08) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x60decc0, 0xc00099ea08) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/types.go:340 +0x2b > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x60e0940?, 0x1a0?, 0x0?}, 0xc00099ea08) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).runLoadedCatalog(0x61173c8, {0xc00133ea08?, 0xc001147e60?, 0x47?}, 0xc00099ea08) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/types.go:129 +0x11f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).RunRulesOfCategory(0x61173c8, {0x3700602, 0x2}, 0xc00099ea08) > /tmp/tmp.VcWBJKPJhc/magefiles/rulesengine/types.go:121 +0x1b4 > main.CI.TestE2E({}) > /tmp/tmp.VcWBJKPJhc/magefiles/magefile.go:330 +0x18a > main.main.func19({0xc00049e8b8?, 0x1ebde2e?}) > /tmp/tmp.VcWBJKPJhc/magefiles/mage_output_file.go:838 +0xf > main.main.func12.1() > /tmp/tmp.VcWBJKPJhc/magefiles/mage_output_file.go:303 +0x5b > created by main.main.func12 in goroutine 1 > /tmp/tmp.VcWBJKPJhc/magefiles/mage_output_file.go:298 +0xbe I0212 01:56:55.401117 19971 common.go:434] Registered PaC server: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-602a2298ad.qj22.p3.openshiftapps.com I0212 01:56:55.458069 19971 common.go:459] The PaC servers registered in Sprayproxy: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-602a2298ad.qj22.p3.openshiftapps.com, https://pipelines-as-code-controller-openshift-pipelines.apps.konflux-4-17-us-west-2-ssbzg.konflux-qe.devcluster.openshift.com I0212 01:56:55.458102 19971 common.go:475] going to create new Tekton bundle remote-build for the purpose of testing multi-platform-controller PR I0212 01:56:55.951767 19971 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.8@sha256:c511ef584e83bd84a9d1d233bdc630dfa7d3a12e595d1cd59cd0cc15ff1247f2 I0212 01:56:55.953996 19971 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770861415-jidx -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0212 01:56:57.266644 19971 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770861415-jidx: quay.io/redhat-appstudio-qe/test-images@sha256:ed44e395d369c603eafd033704299e4e7d9bc4ec3e51f39cea20a9520b4fc5c5 I0212 01:56:57.266665 19971 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_ARM64 to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770861415-jidx I0212 01:56:57.519792 19971 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.8@sha256:c511ef584e83bd84a9d1d233bdc630dfa7d3a12e595d1cd59cd0cc15ff1247f2 I0212 01:56:57.521773 19971 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770861417-ufwg -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0212 01:56:58.899997 19971 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770861417-ufwg: quay.io/redhat-appstudio-qe/test-images@sha256:b16987ffd2800bc51a7829be66c4f2822fed34a9da6e09bc418b95764ce4d647 I0212 01:56:58.900021 19971 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_S390X to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770861417-ufwg I0212 01:56:59.105653 19971 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.8@sha256:c511ef584e83bd84a9d1d233bdc630dfa7d3a12e595d1cd59cd0cc15ff1247f2 I0212 01:56:59.107551 19971 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770861418-opme -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I0212 01:57:00.783146 19971 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770861418-opme: quay.io/redhat-appstudio-qe/test-images@sha256:817ea543619bee5edfd676e30cedd09c7a9169fcc1989de0e5b8fd6007db0267 I0212 01:57:00.783169 19971 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_PPC64LE to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1770861418-opme exec: ginkgo "--seed=1770860778" "--timeout=1h30m0s" "--grace-period=30s" "--output-interceptor-mode=none" "--no-color" "--json-report=e2e-report.json" "--junit-report=e2e-report.xml" "--procs=20" "--nodes=20" "--p" "--output-dir=/workspace/artifact-dir" "./cmd" "--" go: downloading github.com/konflux-ci/build-service v0.0.0-20240611083846-2dee6cfe6fe4 go: downloading github.com/IBM/go-sdk-core/v5 v5.15.3 go: downloading github.com/IBM/vpc-go-sdk v0.48.0 go: downloading github.com/aws/aws-sdk-go-v2 v1.38.1 go: downloading github.com/aws/aws-sdk-go-v2/config v1.31.3 go: downloading github.com/aws/aws-sdk-go-v2/service/ec2 v1.135.0 go: downloading github.com/aws/smithy-go v1.22.5 go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3 go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.28.2 go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.18.7 go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.34.0 go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.18.4 go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.38.0 go: downloading github.com/go-playground/validator/v10 v10.17.0 go: downloading github.com/go-openapi/strfmt v0.23.0 go: downloading go.mongodb.org/mongo-driver v1.17.4 go: downloading github.com/go-openapi/errors v0.22.2 go: downloading github.com/mitchellh/mapstructure v1.5.1-0.20231216201459-8508981c8b6c go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/asaskevich/govalidator v0.0.0-20230301143203-a9d515a09cc2 go: downloading github.com/google/go-github/v45 v45.2.0 go: downloading github.com/leodido/go-urn v1.3.0 go: downloading github.com/gabriel-vasile/mimetype v1.4.3 go: downloading github.com/go-playground/universal-translator v0.18.1 go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.4.4 go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.7.4 go: downloading github.com/go-playground/locales v0.14.1 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.13.0 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.13.4 Running Suite: Red Hat App Studio E2E tests - /tmp/tmp.VcWBJKPJhc/cmd ===================================================================== Random Seed: 1770860778 Will run 199 of 275 specs Running in parallel across 20 processes ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:123 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:128 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:132 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:136 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:178 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:183 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:187 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC Staged Index Post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcStagedIndex] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:191 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:233 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:238 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:242 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC hotfix process FBC hotfix post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcHotfix] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:246 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:286 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification Creates a push snapshot for a release [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:291 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification verifies the fbc release pipelinerun is running and succeeds [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:295 ------------------------------ P [PENDING] [release-pipelines-suite FBC e2e-tests] with FBC pre-GA process FBC pre-GA post-release verification verifies release CR completed and set succeeded. [release-pipelines, fbc-release, fbcPreGA] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/fbc_release.go:299 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies if release CR is created [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_advisories.go:117 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies the advs release pipelinerun is running and succeeds [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_advisories.go:127 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-host-pool] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:120 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_advisories.go:157 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies if the release CR is created [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_push_to_registry_redhat_io.go:108 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-host-pool] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:124 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path Post-release verification verifies if the repository URL is valid [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_advisories.go:168 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies the rhio release pipelinerun is running and succeeds [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_push_to_registry_redhat_io.go:118 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-host-pool] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:127 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies the release CR is created [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/multiarch_advisories.go:112 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_push_to_registry_redhat_io.go:148 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-host-pool] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:148 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies the multiarch release pipelinerun is running and succeeds [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/multiarch_advisories.go:122 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies if the release CR is created [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rhtap_service_push.go:150 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created test that cleanup happened successfully [multi-platform, aws-host-pool] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:152 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path Post-release verification verifies if the MR URL is valid [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_push_to_registry_redhat_io.go:159 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies the rhtap release pipelinerun is running and succeeds [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rhtap_service_push.go:160 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/multiarch_advisories.go:152 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:251 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:255 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rhtap_service_push.go:190 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path Post-release verification verifies if the repository URL is valid [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/multiarch_advisories.go:163 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if release CR is created [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/release_to_github.go:138 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path Post-release verification verifies if the PR in infra-deployments repo is created/updated [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rhtap_service_push.go:200 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies the release pipelinerun is running and succeeds [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/release_to_github.go:148 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:259 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that a Release CR should have been created in the dev namespace [release-pipelines, push-to-external-registry] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/push_to_external_registry.go:157 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/release_to_github.go:181 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:263 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that Release PipelineRun should eventually succeed [release-pipelines, push-to-external-registry] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/push_to_external_registry.go:164 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, aws-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:267 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification tests that Release CR is created for the Snapshot [release-pipelines, rh-push-to-external-registry] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_push_to_external_registry.go:215 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if the Release exists in github repo [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/release_to_github.go:192 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification tests if the image was pushed to quay [release-pipelines, push-to-external-registry] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/push_to_external_registry.go:168 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification verifies a release PipelineRun is started and succeeded in managed namespace [release-pipelines, rh-push-to-external-registry] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_push_to_external_registry.go:226 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmz-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:341 ------------------------------ P [PENDING] [release-pipelines-suite Push to external registry] Post-release verification verifies that a Release is marked as succeeded. [release-pipelines, push-to-external-registry] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/push_to_external_registry.go:175 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmz-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:345 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification validate the result of task create-pyxis-image contains image ids [release-pipelines, rh-push-to-external-registry] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_push_to_external_registry.go:233 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification tests that Release CR has completed [release-pipelines, rh-push-to-external-registry] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_push_to_external_registry.go:248 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmz-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:349 ------------------------------ P [PENDING] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification validates that imageIds from task create-pyxis-image exist in Pyxis. [release-pipelines, rh-push-to-external-registry] /tmp/tmp.VcWBJKPJhc/tests/release/pipelines/rh_push_to_external_registry.go:265 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmz-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:353 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmz-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:357 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context points to a file [build-templates] /tmp/tmp.VcWBJKPJhc/tests/build/tkn-bundle.go:188 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmp-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:432 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles from specific context [build-templates] /tmp/tmp.VcWBJKPJhc/tests/build/tkn-bundle.go:199 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmp-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:436 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context is the root directory [build-templates] /tmp/tmp.VcWBJKPJhc/tests/build/tkn-bundle.go:209 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmp-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:440 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when context points to a file and a directory [build-templates] /tmp/tmp.VcWBJKPJhc/tests/build/tkn-bundle.go:218 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmp-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:444 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when using negation [build-templates] /tmp/tmp.VcWBJKPJhc/tests/build/tkn-bundle.go:228 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmp-dynamic] /tmp/tmp.VcWBJKPJhc/tests/build/multi-platform.go:448 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding HOME environment variable [build-templates] /tmp/tmp.VcWBJKPJhc/tests/build/tkn-bundle.go:238 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding STEP image [build-templates] /tmp/tmp.VcWBJKPJhc/tests/build/tkn-bundle.go:247 ------------------------------ • ------------------------------ • [PANICKED] [11.751 seconds] [upgrade-suite Create users and check their state] [It] Verify AppStudioProvisionedUser [upgrade-verify] /tmp/tmp.VcWBJKPJhc/tests/upgrade/verifyWorkload.go:20 Timeline >> "msg"="Observed a panic" "error"=null "panic"="runtime error: invalid memory address or nil pointer dereference" "panicGoValue"="\"invalid memory address or nil pointer dereference\"" "stacktrace"="goroutine 181 [running]:\nk8s.io/apimachinery/pkg/util/runtime.logPanic({0x3f6fac0, 0xc000f24450}, {0x31c1340, 0x5fb1ba0})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:132 +0xbc\nk8s.io/apimachinery/pkg/util/runtime.handleCrash({0x3f6fb68, 0xc000739570}, {0x31c1340, 0x5fb1ba0}, {0x0, 0x0, 0x447080?})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:107 +0x116\nk8s.io/apimachinery/pkg/util/runtime.HandleCrashWithContext({0x3f6fb68, 0xc000739570}, {0x0, 0x0, 0x0})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:78 +0x5a\npanic({0x31c1340?, 0x5fb1ba0?})\n\t/usr/lib/golang/src/runtime/panic.go:783 +0x132\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp.func1()\n\t/tmp/tmp.VcWBJKPJhc/pkg/sandbox/sandbox.go:319 +0x35\ngithub.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval.func1({0xc000739601?, 0xc0012f2c18?})\n\t/tmp/tmp.VcWBJKPJhc/pkg/utils/util.go:129 +0x13\nk8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1({0x3f6fb68?, 0xc000739570?}, 0x3f6fb68?)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:53 +0x62\nk8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext({0x3f6fb68, 0xc000739570}, {0x3f5d1d0, 0xc00094b5a0}, 0x1, 0x0, 0xc0012f2d90)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:54 +0x115\nk8s.io/apimachinery/pkg/util/wait.PollUntilContextTimeout({0x3f6fa18?, 0x6072740?}, 0xee6b2800, 0x41d745?, 0x1, 0xc0012f2d90)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/poll.go:48 +0xa5\ngithub.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval(0xa?, 0xc0012f2dd8?, 0x1?)\n\t/tmp/tmp.VcWBJKPJhc/pkg/utils/util.go:129 +0x45\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp(0x389c12d?, {0x389c12d?, 0x3898b81?}, 0x8?)\n\t/tmp/tmp.VcWBJKPJhc/pkg/sandbox/sandbox.go:318 +0x72\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreated(0x0, {0x389c12d, 0x9})\n\t/tmp/tmp.VcWBJKPJhc/pkg/sandbox/sandbox.go:314 +0x4b\ngithub.com/konflux-ci/e2e-tests/tests/upgrade/verify.VerifyAppStudioProvisionedUser(0x0?)\n\t/tmp/tmp.VcWBJKPJhc/tests/upgrade/verify/verifyUsers.go:14 +0x25\ngithub.com/konflux-ci/e2e-tests/tests/upgrade.init.func1.2()\n\t/tmp/tmp.VcWBJKPJhc/tests/upgrade/verifyWorkload.go:21 +0x1a\ngithub.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0x0?, 0x0?})\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.27.4/internal/node.go:524 +0x13\ngithub.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.27.4/internal/suite.go:945 +0x393\ncreated by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 31\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.27.4/internal/suite.go:910 +0xd50\n" [PANICKED] in [It] - /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 @ 02/12/26 01:59:14.332 << Timeline [PANICKED] Test Panicked In [It] at: /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 @ 02/12/26 01:59:14.332 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/apimachinery/pkg/util/runtime.handleCrash({0x3f6fb68, 0xc000739570}, {0x31c1340, 0x5fb1ba0}, {0x0, 0x0, 0x447080?}) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 +0x1a9 k8s.io/apimachinery/pkg/util/runtime.HandleCrashWithContext({0x3f6fb68, 0xc000739570}, {0x0, 0x0, 0x0}) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:78 +0x5a panic({0x31c1340?, 0x5fb1ba0?}) /usr/lib/golang/src/runtime/panic.go:783 +0x132 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp.func1() /tmp/tmp.VcWBJKPJhc/pkg/sandbox/sandbox.go:319 +0x35 github.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval.func1({0xc000739601?, 0xc0012f2c18?}) /tmp/tmp.VcWBJKPJhc/pkg/utils/util.go:129 +0x13 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1({0x3f6fb68?, 0xc000739570?}, 0x3f6fb68?) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:53 +0x62 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext({0x3f6fb68, 0xc000739570}, {0x3f5d1d0, 0xc00094b5a0}, 0x1, 0x0, 0xc0012f9d90) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/loop.go:54 +0x115 k8s.io/apimachinery/pkg/util/wait.PollUntilContextTimeout({0x3f6fa18?, 0x6072740?}, 0xee6b2800, 0x41d745?, 0x1, 0xc0012f2d90) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/wait/poll.go:48 +0xa5 github.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval(0xa?, 0xc0012f2dd8?, 0x1?) /tmp/tmp.VcWBJKPJhc/pkg/utils/util.go:129 +0x45 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp(0x389c12d?, {0x389c12d?, 0x3898b81?}, 0x8?) /tmp/tmp.VcWBJKPJhc/pkg/sandbox/sandbox.go:318 +0x72 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreated(0x0, {0x389c12d, 0x9}) /tmp/tmp.VcWBJKPJhc/pkg/sandbox/sandbox.go:314 +0x4b github.com/konflux-ci/e2e-tests/tests/upgrade/verify.VerifyAppStudioProvisionedUser(0x0?) /tmp/tmp.VcWBJKPJhc/tests/upgrade/verify/verifyUsers.go:14 +0x25 github.com/konflux-ci/e2e-tests/tests/upgrade.init.func1.2() /tmp/tmp.VcWBJKPJhc/tests/upgrade/verifyWorkload.go:21 +0x1a ------------------------------ SS•••••••••••••••••••••••••••••••••••••••••••••••S•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.VcWBJKPJhc/tests/build/build_templates.go:489 ------------------------------ ••••••••S ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci build-definitions ec pipelines runs ec pipeline pipelines/enterprise-contract.yaml [build, build-templates, HACBS, pipeline-service, pipeline, build-templates-e2e] /tmp/tmp.VcWBJKPJhc/tests/build/build_templates.go:701 ------------------------------ ••S•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build-oci-ta should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.VcWBJKPJhc/tests/build/build_templates.go:489 ------------------------------ ••S ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci build-definitions ec pipelines runs ec pipeline pipelines/enterprise-contract.yaml [build, build-templates, HACBS, pipeline-service, pipeline, build-templates-e2e] /tmp/tmp.VcWBJKPJhc/tests/build/build_templates.go:701 ------------------------------ •••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• Summarizing 1 Failure: [PANICKED!] [upgrade-suite Create users and check their state] [It] Verify AppStudioProvisionedUser [upgrade-verify] /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:114 Ran 191 of 275 Specs in 1885.758 seconds FAIL! -- 190 Passed | 1 Failed | 76 Pending | 8 Skipped Ginkgo ran 1 suite in 33m27.262252262s Test Suite Failed Error: running "ginkgo --seed=1770860778 --timeout=1h30m0s --grace-period=30s --output-interceptor-mode=none --no-color --json-report=e2e-report.json --junit-report=e2e-report.xml --procs=20 --nodes=20 --p --output-dir=/workspace/artifact-dir ./cmd --" failed with exit code 1 make: *** [Makefile:25: ci/test/e2e] Error 1