./mage -v ci:teste2e go: downloading github.com/shurcooL/graphql v0.0.0-20230722043721-ed46e5a46466 Running target: CI:TestE2E I1216 09:25:13.936685 16589 magefile.go:529] setting up new custom bundle for testing... I1216 09:25:14.437182 16589 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877114-rymn -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: docker-build to image I1216 09:25:15.896576 16589 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877114-rymn: quay.io/redhat-appstudio-qe/test-images@sha256:028516f8e27da4ff1fae0dabd518d4bcf2184d2e8da5cbe0bc9187ebb7b33f73 I1216 09:25:15.896608 16589 magefile.go:535] To use the custom docker bundle locally, run below cmd: export CUSTOM_DOCKER_BUILD_PIPELINE_BUNDLE=quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877114-rymn I1216 09:25:15.896636 16589 e2e_repo.go:347] checking if repository is e2e-tests I1216 09:25:15.896642 16589 e2e_repo.go:335] multi-platform tests and require sprayproxy registering are set to TRUE exec: git "diff" "--name-status" "upstream/main..HEAD" I1216 09:25:15.899592 16589 util.go:451] The following files, go.mod, go.sum, were changed! exec: go "install" "-mod=mod" "github.com/onsi/ginkgo/v2/ginkgo" go: downloading github.com/google/pprof v0.0.0-20241210010833-40e02aabc2ad go: downloading github.com/go-task/slim-sprig/v3 v3.0.0 I1216 09:25:19.140338 16589 install.go:188] cloning 'https://github.com/redhat-appstudio/infra-deployments' with git ref 'refs/heads/main' Enumerating objects: 70629, done. Counting objects: 0% (1/179) Counting objects: 1% (2/179) Counting objects: 2% (4/179) Counting objects: 3% (6/179) Counting objects: 4% (8/179) Counting objects: 5% (9/179) Counting objects: 6% (11/179) Counting objects: 7% (13/179) Counting objects: 8% (15/179) Counting objects: 9% (17/179) Counting objects: 10% (18/179) Counting objects: 11% (20/179) Counting objects: 12% (22/179) Counting objects: 13% (24/179) Counting objects: 14% (26/179) Counting objects: 15% (27/179) Counting objects: 16% (29/179) Counting objects: 17% (31/179) Counting objects: 18% (33/179) Counting objects: 19% (35/179) Counting objects: 20% (36/179) Counting objects: 21% (38/179) Counting objects: 22% (40/179) Counting objects: 23% (42/179) Counting objects: 24% (43/179) Counting objects: 25% (45/179) Counting objects: 26% (47/179) Counting objects: 27% (49/179) Counting objects: 28% (51/179) Counting objects: 29% (52/179) Counting objects: 30% (54/179) Counting objects: 31% (56/179) Counting objects: 32% (58/179) Counting objects: 33% (60/179) Counting objects: 34% (61/179) Counting objects: 35% (63/179) Counting objects: 36% (65/179) Counting objects: 37% (67/179) Counting objects: 38% (69/179) Counting objects: 39% (70/179) Counting objects: 40% (72/179) Counting objects: 41% (74/179) Counting objects: 42% (76/179) Counting objects: 43% (77/179) Counting objects: 44% (79/179) Counting objects: 45% (81/179) Counting objects: 46% (83/179) Counting objects: 47% (85/179) Counting objects: 48% (86/179) Counting objects: 49% (88/179) Counting objects: 50% (90/179) Counting objects: 51% (92/179) Counting objects: 52% (94/179) Counting objects: 53% (95/179) Counting objects: 54% (97/179) Counting objects: 55% (99/179) Counting objects: 56% (101/179) Counting objects: 57% (103/179) Counting objects: 58% (104/179) Counting objects: 59% (106/179) Counting objects: 60% (108/179) Counting objects: 61% (110/179) Counting objects: 62% (111/179) Counting objects: 63% (113/179) Counting objects: 64% (115/179) Counting objects: 65% (117/179) Counting objects: 66% (119/179) Counting objects: 67% (120/179) Counting objects: 68% (122/179) Counting objects: 69% (124/179) Counting objects: 70% (126/179) Counting objects: 71% (128/179) Counting objects: 72% (129/179) Counting objects: 73% (131/179) Counting objects: 74% (133/179) Counting objects: 75% (135/179) Counting objects: 76% (137/179) Counting objects: 77% (138/179) Counting objects: 78% (140/179) Counting objects: 79% (142/179) Counting objects: 80% (144/179) Counting objects: 81% (145/179) Counting objects: 82% (147/179) Counting objects: 83% (149/179) Counting objects: 84% (151/179) Counting objects: 85% (153/179) Counting objects: 86% (154/179) Counting objects: 87% (156/179) Counting objects: 88% (158/179) Counting objects: 89% (160/179) Counting objects: 90% (162/179) Counting objects: 91% (163/179) Counting objects: 92% (165/179) Counting objects: 93% (167/179) Counting objects: 94% (169/179) Counting objects: 95% (171/179) Counting objects: 96% (172/179) Counting objects: 97% (174/179) Counting objects: 98% (176/179) Counting objects: 99% (178/179) Counting objects: 100% (179/179) Counting objects: 100% (179/179), done. Compressing objects: 0% (1/116) Compressing objects: 1% (2/116) Compressing objects: 2% (3/116) Compressing objects: 3% (4/116) Compressing objects: 4% (5/116) Compressing objects: 5% (6/116) Compressing objects: 6% (7/116) Compressing objects: 7% (9/116) Compressing objects: 8% (10/116) Compressing objects: 9% (11/116) Compressing objects: 10% (12/116) Compressing objects: 11% (13/116) Compressing objects: 12% (14/116) Compressing objects: 13% (16/116) Compressing objects: 14% (17/116) Compressing objects: 15% (18/116) Compressing objects: 16% (19/116) Compressing objects: 17% (20/116) Compressing objects: 18% (21/116) Compressing objects: 19% (23/116) Compressing objects: 20% (24/116) Compressing objects: 21% (25/116) Compressing objects: 22% (26/116) Compressing objects: 23% (27/116) Compressing objects: 24% (28/116) Compressing objects: 25% (29/116) Compressing objects: 26% (31/116) Compressing objects: 27% (32/116) Compressing objects: 28% (33/116) Compressing objects: 29% (34/116) Compressing objects: 30% (35/116) Compressing objects: 31% (36/116) Compressing objects: 32% (38/116) Compressing objects: 33% (39/116) Compressing objects: 34% (40/116) Compressing objects: 35% (41/116) Compressing objects: 36% (42/116) Compressing objects: 37% (43/116) Compressing objects: 38% (45/116) Compressing objects: 39% (46/116) Compressing objects: 40% (47/116) Compressing objects: 41% (48/116) Compressing objects: 42% (49/116) Compressing objects: 43% (50/116) Compressing objects: 44% (52/116) Compressing objects: 45% (53/116) Compressing objects: 46% (54/116) Compressing objects: 47% (55/116) Compressing objects: 48% (56/116) Compressing objects: 49% (57/116) Compressing objects: 50% (58/116) Compressing objects: 51% (60/116) Compressing objects: 52% (61/116) Compressing objects: 53% (62/116) Compressing objects: 54% (63/116) Compressing objects: 55% (64/116) Compressing objects: 56% (65/116) Compressing objects: 57% (67/116) Compressing objects: 58% (68/116) Compressing objects: 59% (69/116) Compressing objects: 60% (70/116) Compressing objects: 61% (71/116) Compressing objects: 62% (72/116) Compressing objects: 63% (74/116) Compressing objects: 64% (75/116) Compressing objects: 65% (76/116) Compressing objects: 66% (77/116) Compressing objects: 67% (78/116) Compressing objects: 68% (79/116) Compressing objects: 69% (81/116) Compressing objects: 70% (82/116) Compressing objects: 71% (83/116) Compressing objects: 72% (84/116) Compressing objects: 73% (85/116) Compressing objects: 74% (86/116) Compressing objects: 75% (87/116) Compressing objects: 76% (89/116) Compressing objects: 77% (90/116) Compressing objects: 78% (91/116) Compressing objects: 79% (92/116) Compressing objects: 80% (93/116) Compressing objects: 81% (94/116) Compressing objects: 82% (96/116) Compressing objects: 83% (97/116) Compressing objects: 84% (98/116) Compressing objects: 85% (99/116) Compressing objects: 86% (100/116) Compressing objects: 87% (101/116) Compressing objects: 88% (103/116) Compressing objects: 89% (104/116) Compressing objects: 90% (105/116) Compressing objects: 91% (106/116) Compressing objects: 92% (107/116) Compressing objects: 93% (108/116) Compressing objects: 94% (110/116) Compressing objects: 95% (111/116) Compressing objects: 96% (112/116) Compressing objects: 97% (113/116) Compressing objects: 98% (114/116) Compressing objects: 99% (115/116) Compressing objects: 100% (116/116) Compressing objects: 100% (116/116), done. Total 70629 (delta 113), reused 64 (delta 63), pack-reused 70450 (from 3) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. Installing the OpenShift GitOps operator subscription: clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created subscription.operators.coreos.com/openshift-gitops-operator created Waiting for default project (and namespace) to exist: ....................................OK Waiting for OpenShift GitOps Route: OK argocd.argoproj.io/openshift-gitops patched argocd.argoproj.io/openshift-gitops patched Switch the Route to use re-encryption argocd.argoproj.io/openshift-gitops patched Restarting ArgoCD Server pod "openshift-gitops-server-78868c5878-zz6lj" deleted Allow any authenticated users to be admin on the Argo CD instance argocd.argoproj.io/openshift-gitops patched Mark Pending PVC as Healthy, workaround for WaitForFirstConsumer StorageClasses. Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) Setting kustomize build options argocd.argoproj.io/openshift-gitops patched Setting ignore Aggregated Roles argocd.argoproj.io/openshift-gitops patched Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched Restarting GitOps server deployment.apps/openshift-gitops-server restarted ========================================================================= Argo CD URL is: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-33ac32b7cd.cpmk.p3.openshiftapps.com (NOTE: It may take a few moments for the route to become available) Waiting for the route: .OK Login/password uses your OpenShift credentials ('Login with OpenShift' button) Setting secrets for Quality Dashboard namespace/quality-dashboard created secret/quality-dashboard-secrets created Creating secret for CI Helper App namespace/ci-helper-app created secret/ci-helper-app-secrets created Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation namespace/product-kubearchive-logging created Creating DB secret secret/tekton-results-database created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config secret/minio-storage-configuration created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config MinIO config already exists, skipping creation Creating Postgres TLS certs ........+.........+...+....+...+........+...+.+..............+....+......+..............+.......+...+.....+...+...+..........+.....+++++++++++++++++++++++++++++++++++++++*.+.....+....+.........+......+...+........+.......+...+...+.....+..........+..+++++++++++++++++++++++++++++++++++++++*....+.......+......+..+...+.+...............+......+.....+..................+....+......+..+...+.......+...+.........+......+............+..+............+.+........+.....................+.........+.+...+..+.............+.....+..........+........+...+.+..............+......+.+..............+.+...+......+...+...+.......................+....+..+.+..............+...+.......+........+......+.+..........................+....+...+.....+......+.+......+.....+...+....+...+..+...+....+...+..+.........+.......+.....+.............+......+........+.......+.....+...+................+..+......................+......+..+...+....+...........+....+...........+......+...+.+..+....+.....+.+.....+.........+.+...+.........+..+.+..............+...+...+............+.+............+..+.+...........+...+...+...+....+..++++++ .+......+......+...+......+.+.....+....+..+..........+.....+....+.....+....+...........+...+............+....+.....+....+.....+...+...+.+......+..+.+.....+.......+..+.+..+...............+....+.....+.+...+..+.........+....+...............+..+..........+..+............+...+++++++++++++++++++++++++++++++++++++++*..+.....+......+...+......+....+..+...+....+........+....+.....+...+++++++++++++++++++++++++++++++++++++++*....+....+...+..+...+......+.+...........+...+....+..+.+........+..........+......+.....+.+..+......+..........+..+.......+..+.............+.....+...+....+...+......+..+....+...+..+..........+........+...+.......+..+.+..+...+.........+....+..++++++ ----- Certificate request self-signature ok subject=CN=cluster.local ....+......+.....+...+++++++++++++++++++++++++++++++++++++++*.+..+.+........+......+.+++++++++++++++++++++++++++++++++++++++*.........+.+......+...+.....+.......+..+.............+...+.........+..+.+.....+....+.........+.........+...+........+...............+..........+......+...+..+.............+........+.........+.+..................+.....+.+......+..+..........+..+.........+..........+.....+.......+.....+....+...+..++++++ .....+..............+.+.....+.......+..+....+............+........+.+.....+.+..+.......+.....+......+....+...+.....+......+.+.....+......+...+.........+...+............+......+....+++++++++++++++++++++++++++++++++++++++*.+....+...........+....+..+.+.....+............+.+..+...+.......+..+......+.........+.+......+++++++++++++++++++++++++++++++++++++++*..+...........+....+......+......+.........+...+...........+......+.........+....+...+..+...+.........................+..+.+......+...+..+...+.............+..+.......+...+..+...+...............+...............+...+...+......+.+...+..+.......+..+.+..+..........+......+......+...+......+..+............+.......+.....+.........+.+........+...+...+....+......+..+...+....+..+.+.........+...+.....+...+..........+........+.+.........+......+......+...+.....+......+.+..+.....................+......+.............+..+......+...+............+.......+.....+.............+........+....+............+.....+................+.........+........+.+.....+.......+........+......+.+..+.+.....+.+......+.........+...+...+..+............+....+...........+.+.....+.......+..+..........+...+...+........+...............+..........++++++ ----- Certificate request self-signature ok subject=CN=postgres-postgresql.tekton-results.svc.cluster.local secret/postgresql-tls created configmap/rds-root-crt created namespace/application-service created Creating a has secret from legacy token secret/has-github-token created Creating a secret with a token for Image Controller namespace/image-controller created secret/quaytoken created Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.6HTmizclKl secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.6HTmizclKl secret/docker-io-pull created Setting secrets for Dora metrics exporter namespace/dora-metrics created secret/exporters-secret created Setting Cluster Mode: preview Switched to a new branch 'preview-main-fvpb' labeling node/ip-10-0-136-171.ec2.internal... node/ip-10-0-136-171.ec2.internal labeled successfully labeled node/ip-10-0-136-171.ec2.internal labeling node/ip-10-0-149-87.ec2.internal... node/ip-10-0-149-87.ec2.internal labeled successfully labeled node/ip-10-0-149-87.ec2.internal labeling node/ip-10-0-165-251.ec2.internal... node/ip-10-0-165-251.ec2.internal labeled successfully labeled node/ip-10-0-165-251.ec2.internal verifying labels... all nodes labeled successfully. Detected OCP minor version: 17 Changing AppStudio Gitlab Org to "redhat-appstudio-qe" [preview-main-fvpb 43f066267] Preview mode, do not merge into main 6 files changed, 12 insertions(+), 18 deletions(-) remote: remote: Create a pull request for 'preview-main-fvpb' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-fvpb remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-fvpb -> preview-main-fvpb branch 'preview-main-fvpb' set up to track 'qe/preview-main-fvpb'. application.argoproj.io/all-application-sets created Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app application.argoproj.io/dora-metrics-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/monitoring-registry-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) application.argoproj.io/image-rbac-proxy-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/has-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/monitoring-workload-grafana-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync All Applications are synced and Healthy All required tekton resources are installed and ready Tekton CRDs are ready Setup Pac with existing QE sprayproxy and github App namespace/openshift-pipelines configured namespace/build-service configured namespace/integration-service configured secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created Configured pipelines-as-code-secret secret in openshift-pipelines namespace Switched to branch 'main' Your branch is up to date with 'upstream/main'. [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 93 [running]: > runtime/debug.Stack() > /usr/lib/golang/src/runtime/debug/stack.go:26 +0x5e > sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot() > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/log/log.go:60 +0xcd > sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0xc0005b1700, {0x2f94a36, 0x14}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/log/deleg.go:147 +0x3e > github.com/go-logr/logr.Logger.WithName({{0x36ee510, 0xc0005b1700}, 0x0}, {0x2f94a36?, 0x0?}) > /opt/app-root/src/go/pkg/mod/github.com/go-logr/logr@v1.4.2/logr.go:345 +0x36 > sigs.k8s.io/controller-runtime/pkg/client.newClient(0x2d72320?, {0x0, 0xc000302620, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/client/client.go:129 +0xf1 > sigs.k8s.io/controller-runtime/pkg/client.New(0xc0008e38c8?, {0x0, 0xc000302620, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/client/client.go:110 +0x7d > github.com/konflux-ci/e2e-tests/pkg/clients/kubernetes.NewAdminKubernetesClient() > /tmp/tmp.yfa6AEOzDs/pkg/clients/kubernetes/client.go:157 +0xa5 > github.com/konflux-ci/e2e-tests/pkg/clients/sprayproxy.GetPaCHost() > /tmp/tmp.yfa6AEOzDs/pkg/clients/sprayproxy/sprayproxy.go:93 +0x1c > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.registerPacServer() > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/repos/common.go:426 +0x78 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.init.func8(0xc0009f1688?) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/repos/common.go:378 +0x25 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.ActionFunc.Execute(0xc?, 0x2f6f495?) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/types.go:279 +0x19 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Apply(...) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/types.go:315 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x5246220, 0xc0009f1688) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/types.go:348 +0xb3 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x523eca0?, 0xc001111c00?, 0x1f1bc99?}, 0xc0009f1688) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x52462e0, 0xc0009f1688) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/types.go:340 +0x2b > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x5247f60?, 0x4295dc?, 0x52c9b60?}, 0xc0009f1688) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).runLoadedCatalog(0x527d990, {0xc0013fcc88?, 0xc001217e60?, 0x47?}, 0xc0009f1688) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/types.go:129 +0x119 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).RunRulesOfCategory(0x527d990, {0x2f69843, 0x2}, 0xc0009f1688) > /tmp/tmp.yfa6AEOzDs/magefiles/rulesengine/types.go:121 +0x1b4 > main.CI.TestE2E({}) > /tmp/tmp.yfa6AEOzDs/magefiles/magefile.go:330 +0x18a > main.main.func19({0x0?, 0x0?}) > /tmp/tmp.yfa6AEOzDs/magefiles/mage_output_file.go:827 +0xf > main.main.func12.1() > /tmp/tmp.yfa6AEOzDs/magefiles/mage_output_file.go:302 +0x5b > created by main.main.func12 in goroutine 1 > /tmp/tmp.yfa6AEOzDs/magefiles/mage_output_file.go:297 +0xbe I1216 09:34:51.761167 16589 common.go:434] Registered PaC server: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-33ac32b7cd.cpmk.p3.openshiftapps.com I1216 09:34:51.832054 16589 common.go:459] The PaC servers registered in Sprayproxy: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-5140b66bf3.tn5s.p3.openshiftapps.com, https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-33ac32b7cd.cpmk.p3.openshiftapps.com I1216 09:34:51.832078 16589 common.go:475] going to create new Tekton bundle remote-build for the purpose of testing multi-platform-controller PR I1216 09:34:52.150642 16589 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.7@sha256:8b16e4e79853e3a3192f82e9f8930b79b04942bb389eaab4c44fb4d233ccefe6 I1216 09:34:52.153078 16589 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877691-aacm -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I1216 09:34:53.739085 16589 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877691-aacm: quay.io/redhat-appstudio-qe/test-images@sha256:e789889867d6cd056ec7c8348672b803fd4b34df583b7cd71fb692624c077c1d I1216 09:34:53.739102 16589 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_ARM64 to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877691-aacm I1216 09:34:53.959315 16589 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.7@sha256:8b16e4e79853e3a3192f82e9f8930b79b04942bb389eaab4c44fb4d233ccefe6 I1216 09:34:53.962809 16589 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877693-tarb -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I1216 09:34:55.351237 16589 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877693-tarb: quay.io/redhat-appstudio-qe/test-images@sha256:215069152c50d12272ddc912647e7e0cc3b32e751c1024e52eb6a0576461cbd6 I1216 09:34:55.351258 16589 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_S390X to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877693-tarb I1216 09:34:55.586537 16589 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.7@sha256:8b16e4e79853e3a3192f82e9f8930b79b04942bb389eaab4c44fb4d233ccefe6 I1216 09:34:55.588522 16589 util.go:512] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877695-nrjz -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I1216 09:34:56.920079 16589 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877695-nrjz: quay.io/redhat-appstudio-qe/test-images@sha256:232a8df9be404b5bd549b7c66dc7eefcc89a120d9c95391fcf3e98385ccfc73d I1216 09:34:56.920112 16589 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_PPC64LE to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1765877695-nrjz exec: ginkgo "--seed=1765877113" "--timeout=1h30m0s" "--grace-period=30s" "--output-interceptor-mode=none" "--no-color" "--json-report=e2e-report.json" "--junit-report=e2e-report.xml" "--procs=20" "--nodes=20" "--p" "--output-dir=/workspace/artifact-dir" "./cmd" "--" go: downloading github.com/konflux-ci/build-service v0.0.0-20240611083846-2dee6cfe6fe4 go: downloading github.com/IBM/go-sdk-core/v5 v5.15.3 go: downloading github.com/IBM/vpc-go-sdk v0.48.0 go: downloading github.com/aws/aws-sdk-go-v2 v1.32.7 go: downloading github.com/aws/aws-sdk-go-v2/config v1.28.7 go: downloading github.com/aws/aws-sdk-go-v2/service/ec2 v1.135.0 go: downloading github.com/go-playground/validator/v10 v10.17.0 go: downloading github.com/go-openapi/strfmt v0.22.0 go: downloading github.com/aws/smithy-go v1.22.1 go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.17.48 go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.22 go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.8.1 go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.24.8 go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.28.7 go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.33.3 go: downloading github.com/asaskevich/govalidator v0.0.0-20230301143203-a9d515a09cc2 go: downloading github.com/go-openapi/errors v0.21.0 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/oklog/ulid v1.3.1 go: downloading go.mongodb.org/mongo-driver v1.13.1 go: downloading github.com/google/go-github/v45 v45.2.0 go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.26 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.1 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.7 go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.26 go: downloading github.com/leodido/go-urn v1.3.0 go: downloading github.com/gabriel-vasile/mimetype v1.4.3 go: downloading github.com/go-playground/universal-translator v0.18.1 go: downloading github.com/go-playground/locales v0.14.1 Running Suite: Red Hat App Studio E2E tests - /tmp/tmp.yfa6AEOzDs/cmd ===================================================================== Random Seed: 1765877113 Will run 353 of 387 specs Running in parallel across 20 processes ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context points to a file [build-templates] /tmp/tmp.yfa6AEOzDs/tests/build/tkn-bundle.go:177 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles from specific context [build-templates] /tmp/tmp.yfa6AEOzDs/tests/build/tkn-bundle.go:188 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context is the root directory [build-templates] /tmp/tmp.yfa6AEOzDs/tests/build/tkn-bundle.go:198 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when context points to a file and a directory [build-templates] /tmp/tmp.yfa6AEOzDs/tests/build/tkn-bundle.go:207 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when using negation [build-templates] /tmp/tmp.yfa6AEOzDs/tests/build/tkn-bundle.go:217 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding HOME environment variable [build-templates] /tmp/tmp.yfa6AEOzDs/tests/build/tkn-bundle.go:227 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding STEP image [build-templates] /tmp/tmp.yfa6AEOzDs/tests/build/tkn-bundle.go:236 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-host-pool] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:120 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-host-pool] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:124 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-host-pool] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:127 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-host-pool] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:148 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created test that cleanup happened successfully [multi-platform, aws-host-pool] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:152 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:251 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:255 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:259 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:263 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, aws-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:267 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmz-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:341 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmz-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:345 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmz-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:349 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmz-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:353 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmz-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:357 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if release CR is created [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/release_to_github.go:139 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmp-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:432 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmp-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:436 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies the release pipelinerun is running and succeeds [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/release_to_github.go:149 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmp-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:440 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmp-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:444 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/release_to_github.go:182 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmp-dynamic] /tmp/tmp.yfa6AEOzDs/tests/build/multi-platform.go:448 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if the Release exists in github repo [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/release_to_github.go:193 ------------------------------ • [FAILED] [0.217 seconds] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path [BeforeAll] Post-release verification verifies the release CR is created [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] [BeforeAll] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/multiarch_advisories.go:61 [It] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/multiarch_advisories.go:113 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 @ 12/16/25 09:36:30.903 [PANICKED] in [AfterAll] - /usr/lib/golang/src/runtime/panic.go:262 @ 12/16/25 09:36:30.904 << Timeline [FAILED] Unexpected error: <*url.Error | 0xc000bdd110>: Get "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host { Op: "Get", URL: "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis", Err: <*net.OpError | 0xc000134410>{ Op: "dial", Net: "tcp", Source: nil, Addr: nil, Err: <*net.DNSError | 0xc0001342d0>{ UnwrapErr: nil, Err: "no such host", Name: "api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com", Server: "172.30.0.10:53", IsTimeout: false, IsTemporary: false, IsNotFound: true, }, }, } occurred In [BeforeAll] at: /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 @ 12/16/25 09:36:30.903 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSS ------------------------------ • [FAILED] [0.214 seconds] [release-pipelines-suite FBC e2e-tests] with FBC happy path [BeforeAll] Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHappyPath] [BeforeAll] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/fbc_release.go:89 [It] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/fbc_release.go:123 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 @ 12/16/25 09:36:31.1 [PANICKED] in [AfterAll] - /usr/lib/golang/src/runtime/panic.go:262 @ 12/16/25 09:36:31.101 << Timeline [FAILED] Unexpected error: <*url.Error | 0xc000a71590>: Get "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host { Op: "Get", URL: "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis", Err: <*net.OpError | 0xc000c5ea50>{ Op: "dial", Net: "tcp", Source: nil, Addr: nil, Err: <*net.DNSError | 0xc000c5e8c0>{ UnwrapErr: nil, Err: "no such host", Name: "api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com", Server: "172.30.0.10:53", IsTimeout: false, IsTemporary: false, IsNotFound: true, }, }, } occurred In [BeforeAll] at: /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 @ 12/16/25 09:36:31.1 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSSSSSSSSSS ------------------------------ • [FAILED] [0.307 seconds] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path [BeforeAll] Post-release verification verifies if release CR is created [release-pipelines, rh-advisories, rhAdvisories] [BeforeAll] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rh_advisories.go:61 [It] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rh_advisories.go:118 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 @ 12/16/25 09:36:31.103 [PANICKED] in [AfterAll] - /usr/lib/golang/src/runtime/panic.go:262 @ 12/16/25 09:36:31.103 << Timeline [FAILED] Unexpected error: <*url.Error | 0xc001a16150>: Get "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host { Op: "Get", URL: "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis", Err: <*net.OpError | 0xc00018d3b0>{ Op: "dial", Net: "tcp", Source: nil, Addr: nil, Err: <*net.DNSError | 0xc000c29860>{ UnwrapErr: nil, Err: "no such host", Name: "api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com", Server: "172.30.0.10:53", IsTimeout: false, IsTemporary: false, IsNotFound: true, }, }, } occurred In [BeforeAll] at: /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 @ 12/16/25 09:36:31.103 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSSSSSS ------------------------------ • [FAILED] [0.518 seconds] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path [BeforeAll] Post-release verification verifies if the release CR is created [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] [BeforeAll] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rh_push_to_registry_redhat_io.go:61 [It] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rh_push_to_registry_redhat_io.go:110 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 @ 12/16/25 09:36:31.109 [PANICKED] in [AfterAll] - /usr/lib/golang/src/runtime/panic.go:262 @ 12/16/25 09:36:31.312 << Timeline [FAILED] Unexpected error: <*url.Error | 0xc00126e210>: Get "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host { Op: "Get", URL: "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis", Err: <*net.OpError | 0xc000f160a0>{ Op: "dial", Net: "tcp", Source: nil, Addr: nil, Err: <*net.DNSError | 0xc000f960a0>{ UnwrapErr: nil, Err: "no such host", Name: "api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com", Server: "172.30.0.10:53", IsTimeout: false, IsTemporary: false, IsNotFound: true, }, }, } occurred In [BeforeAll] at: /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 @ 12/16/25 09:36:31.109 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSS ------------------------------ • [FAILED] [3.652 seconds] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path [BeforeAll] Post-release verification verifies if the release CR is created [release-pipelines, rhtap-service-push, RhtapServicePush] [BeforeAll] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rhtap_service_push.go:75 [It] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rhtap_service_push.go:150 Timeline >> PR #3648 got created with sha cf6e43c5a0c8673b4a1219761b1b4252a7849cd3 merged result sha: 47df8305ca308d80e1f3f0ccbd767eeb68da0f2c for PR #3648 [FAILED] in [BeforeAll] - /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rhtap_service_push.go:119 @ 12/16/25 09:36:34.445 [PANICKED] in [AfterAll] - /usr/lib/golang/src/runtime/panic.go:262 @ 12/16/25 09:36:34.445 << Timeline [FAILED] Unexpected error: <*fmt.wrapError | 0xc000b5f9c0>: failed to get API group resources: unable to retrieve the complete list of server APIs: appstudio.redhat.com/v1alpha1: Get "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/apis/appstudio.redhat.com/v1alpha1": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host { msg: "failed to get API group resources: unable to retrieve the complete list of server APIs: appstudio.redhat.com/v1alpha1: Get \"https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/apis/appstudio.redhat.com/v1alpha1\": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host", err: <*apiutil.ErrResourceDiscoveryFailed | 0xc000395540>{ { Group: "appstudio.redhat.com", Version: "v1alpha1", }: <*url.Error | 0xc0016a4120>{ Op: "Get", URL: "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/apis/appstudio.redhat.com/v1alpha1", Err: <*net.OpError | 0xc000d46870>{ Op: "dial", Net: "tcp", Source: nil, Addr: nil, Err: <*net.DNSError | 0xc000d46730>{ UnwrapErr: nil, Err: "no such host", Name: "api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com", Server: "172.30.0.10:53", IsTimeout: false, IsTemporary: false, IsNotFound: true, }, }, }, }, } occurred In [BeforeAll] at: /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rhtap_service_push.go:119 @ 12/16/25 09:36:34.445 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSS•• ------------------------------ • [FAILED] [7.187 seconds] [integration-service-suite Integration Service E2E tests] with happy path for general flow of Integration service [BeforeAll] when a new Component is created triggers a build PipelineRun [integration-service] [BeforeAll] /tmp/tmp.yfa6AEOzDs/tests/integration-service/integration.go:52 [It] /tmp/tmp.yfa6AEOzDs/tests/integration-service/integration.go:85 [FAILED] Unexpected error: <*errors.errorString | 0xc00011c2e0>: error when getting the base branch name 'onboarding' for the repo 'konflux-test-integration': GET https://api.github.com/repos/redhat-appstudio-qe/konflux-test-integration/git/ref/heads/onboarding: 404 Not Found [] { s: "error when getting the base branch name 'onboarding' for the repo 'konflux-test-integration': GET https://api.github.com/repos/redhat-appstudio-qe/konflux-test-integration/git/ref/heads/onboarding: 404 Not Found []", } occurred In [BeforeAll] at: /tmp/tmp.yfa6AEOzDs/tests/integration-service/integration.go:437 @ 12/16/25 09:36:36.667 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [PANICKED] [8.049 seconds] [upgrade-suite Create users and check their state] [It] Verify AppStudioProvisionedUser [upgrade-verify] /tmp/tmp.yfa6AEOzDs/tests/upgrade/verifyWorkload.go:20 Timeline >> "msg"="Observed a panic: \"invalid memory address or nil pointer dereference\" (runtime error: invalid memory address or nil pointer dereference)\ngoroutine 72 [running]:\nk8s.io/apimachinery/pkg/util/runtime.logPanic({0x2c4aca0, 0x5408340})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:75 +0x85\nk8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc00101ac40?})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:49 +0x65\npanic({0x2c4aca0?, 0x5408340?})\n\t/usr/lib/golang/src/runtime/panic.go:792 +0x132\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp.func1()\n\t/tmp/tmp.yfa6AEOzDs/pkg/sandbox/sandbox.go:319 +0x35\ngithub.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval.func1({0xee6b2800?, 0x0?})\n\t/tmp/tmp.yfa6AEOzDs/pkg/utils/util.go:129 +0x13\nk8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1(0xc000f84920?, {0x384f6e8?, 0xc00061ad20?})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/loop.go:53 +0x52\nk8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext({0x384f6e8, 0xc00061ad20}, {0x38441b0, 0xc000f84920}, 0x1, 0x0, 0xc000806e68)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/loop.go:54 +0x115\nk8s.io/apimachinery/pkg/util/wait.PollUntilContextTimeout({0x384f598?, 0x54be4c0?}, 0xee6b2800, 0x419be5?, 0x1, 0xc000806e68)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/poll.go:48 +0xa5\ngithub.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval(0xa?, 0xc000806eb0?, 0x1?)\n\t/tmp/tmp.yfa6AEOzDs/pkg/utils/util.go:129 +0x45\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp(0x323c649?, {0x323c649?, 0x323928a?}, 0x8?)\n\t/tmp/tmp.yfa6AEOzDs/pkg/sandbox/sandbox.go:318 +0x72\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreated(0x0, {0x323c649, 0x9})\n\t/tmp/tmp.yfa6AEOzDs/pkg/sandbox/sandbox.go:314 +0x4b\ngithub.com/konflux-ci/e2e-tests/tests/upgrade/verify.VerifyAppStudioProvisionedUser(0xc00101b398?)\n\t/tmp/tmp.yfa6AEOzDs/tests/upgrade/verify/verifyUsers.go:14 +0x25\ngithub.com/konflux-ci/e2e-tests/tests/upgrade.init.func1.2()\n\t/tmp/tmp.yfa6AEOzDs/tests/upgrade/verifyWorkload.go:21 +0x1a\ngithub.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0x7c2986?, 0xc000a8af00?})\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.22.2/internal/node.go:475 +0x13\ngithub.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.22.2/internal/suite.go:894 +0x7b\ncreated by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 81\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.22.2/internal/suite.go:881 +0xd7b" "error"=null [PANICKED] in [It] - /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:56 @ 12/16/25 09:36:38.737 << Timeline [PANICKED] Test Panicked In [It] at: /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:56 @ 12/16/25 09:36:38.737 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc00101ac40?}) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:56 +0xc7 panic({0x2c4aca0?, 0x5408340?}) /usr/lib/golang/src/runtime/panic.go:792 +0x132 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp.func1() /tmp/tmp.yfa6AEOzDs/pkg/sandbox/sandbox.go:319 +0x35 github.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval.func1({0xee6b2800?, 0x0?}) /tmp/tmp.yfa6AEOzDs/pkg/utils/util.go:129 +0x13 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1(0xc000f84920?, {0x384f6e8?, 0xc00061ad20?}) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/loop.go:53 +0x52 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext({0x384f6e8, 0xc00061ad20}, {0x38441b0, 0xc000f84920}, 0x1, 0x0, 0xc00137de68) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/loop.go:54 +0x115 k8s.io/apimachinery/pkg/util/wait.PollUntilContextTimeout({0x384f598?, 0x54be4c0?}, 0xee6b2800, 0x419be5?, 0x1, 0xc000806e68) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/poll.go:48 +0xa5 github.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval(0xa?, 0xc000806eb0?, 0x1?) /tmp/tmp.yfa6AEOzDs/pkg/utils/util.go:129 +0x45 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp(0x323c649?, {0x323c649?, 0x323928a?}, 0x8?) /tmp/tmp.yfa6AEOzDs/pkg/sandbox/sandbox.go:318 +0x72 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreated(0x0, {0x323c649, 0x9}) /tmp/tmp.yfa6AEOzDs/pkg/sandbox/sandbox.go:314 +0x4b github.com/konflux-ci/e2e-tests/tests/upgrade/verify.VerifyAppStudioProvisionedUser(0xc00101b398?) /tmp/tmp.yfa6AEOzDs/tests/upgrade/verify/verifyUsers.go:14 +0x25 github.com/konflux-ci/e2e-tests/tests/upgrade.init.func1.2() /tmp/tmp.yfa6AEOzDs/tests/upgrade/verifyWorkload.go:21 +0x1a ------------------------------ SS ------------------------------ • [FAILED] [11.239 seconds] [integration-service-suite Status Reporting of Integration tests] with status reporting of Integration tests in CheckRuns [BeforeAll] when a new Component with specified custom branch is created does not contain an annotation with a Snapshot Name [integration-service, github-status-reporting, custom-branch] [BeforeAll] /tmp/tmp.yfa6AEOzDs/tests/integration-service/status-reporting-to-pullrequest.go:45 [It] /tmp/tmp.yfa6AEOzDs/tests/integration-service/status-reporting-to-pullrequest.go:109 [FAILED] Unexpected error: <*errors.errorString | 0xc000749570>: error when getting the base branch name 'onboarding' for the repo 'konflux-test-integration-status-report': GET https://api.github.com/repos/redhat-appstudio-qe/konflux-test-integration-status-report/git/ref/heads/onboarding: 404 Not Found [] { s: "error when getting the base branch name 'onboarding' for the repo 'konflux-test-integration-status-report': GET https://api.github.com/repos/redhat-appstudio-qe/konflux-test-integration-status-report/git/ref/heads/onboarding: 404 Not Found []", } occurred In [BeforeAll] at: /tmp/tmp.yfa6AEOzDs/tests/integration-service/integration.go:437 @ 12/16/25 09:36:39.339 ------------------------------ SSSSSSSSSSSSSSSSSSSSSS••••••••••••••••• ------------------------------ • [FAILED] [57.545 seconds] [integration-service-suite Gitlab Status Reporting of Integration tests] Gitlab with status reporting of Integration tests in the assosiated merge request [BeforeAll] when a new Component with specified custom branch is created triggers a Build PipelineRun [integration-service, gitlab-status-reporting, custom-branch] [BeforeAll] /tmp/tmp.yfa6AEOzDs/tests/integration-service/gitlab-integration-reporting.go:46 [It] /tmp/tmp.yfa6AEOzDs/tests/integration-service/gitlab-integration-reporting.go:121 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.yfa6AEOzDs/tests/integration-service/gitlab-integration-reporting.go:62 @ 12/16/25 09:37:31.651 [FAILED] in [AfterAll] - /tmp/tmp.yfa6AEOzDs/tests/integration-service/gitlab-integration-reporting.go:88 @ 12/16/25 09:37:31.83 << Timeline [FAILED] Unexpected error: <*errors.StatusError | 0xc0007eb900>: admission webhook "dintegrationtestscenario.kb.io" denied the request: could not find application 'integ-app-lmjv' in namespace 'gitlab-rep-byut' { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "admission webhook \"dintegrationtestscenario.kb.io\" denied the request: could not find application 'integ-app-lmjv' in namespace 'gitlab-rep-byut'", Reason: "Forbidden", Details: nil, Code: 403, }, } occurred In [BeforeAll] at: /tmp/tmp.yfa6AEOzDs/tests/integration-service/gitlab-integration-reporting.go:62 @ 12/16/25 09:37:31.651 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSSSSSSSSSSSSSSSSSSS•••••••••••••••••••••••••••••••••••••••••••• ------------------------------ • [FAILED] [0.383 seconds] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification [It] validate the result of task create-pyxis-image contains image ids [release-pipelines, rh-push-to-external-registry] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rh_push_to_external_registry.go:233 [FAILED] Unexpected error: <*errors.errorString | 0xc0007bd2f0>: task with create-pyxis-image name doesn't exist in managed-wwvc4 pipelinerun { s: "task with create-pyxis-image name doesn't exist in managed-wwvc4 pipelinerun", } occurred In [It] at: /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rh_push_to_external_registry.go:236 @ 12/16/25 09:39:55.057 ------------------------------ SS• ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test build secret lookup when two secrets are created when second component is deleted, pac pr branch should not exist in the repo [build-service, pac-build, secret-lookup] /tmp/tmp.yfa6AEOzDs/tests/build/build.go:1121 ------------------------------ ••••••••••S•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.yfa6AEOzDs/tests/build/build_templates.go:489 ------------------------------ ••••••• ------------------------------ • [FAILED] [1.509 seconds] [build-service-suite Build service E2E tests] test PaC component build github when a new Component with specified custom branch is created [It] eventually leads to the PipelineRun status report at Checks tab [build-service, github-webhook, pac-build, pipeline, image-controller, build-custom-branch] /tmp/tmp.yfa6AEOzDs/tests/build/build.go:449 [FAILED] Expected : failure to equal : success In [It] at: /tmp/tmp.yfa6AEOzDs/tests/build/build.go:453 @ 12/16/25 09:44:37.005 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•••••••S•••••••••••••••S•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build-oci-ta should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.yfa6AEOzDs/tests/build/build_templates.go:489 ------------------------------ •••••••••••S•••••••••••••••••••••••••••••••••••••••••••••••••••••••••• ------------------------------ • [FAILED] [1801.990 seconds] [integration-service-suite Creation of group snapshots for monorepo and multiple repos] with status reporting of Integration tests in CheckRuns when both the init PaC PRs are merged [It] get all group snapshots and check if pr-group annotation contains all components [integration-service, group-snapshot-creation] /tmp/tmp.yfa6AEOzDs/tests/integration-service/group-snapshots-tests.go:505 Timeline >> Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 4 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 5 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 5 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 5 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 5 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 5 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 6 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 7 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:1] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 8 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:2] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. Attempting to find group snapshots for application integ-app-fnjk in namespace group-flmt Found 9 component snapshots: PR Groups found: map[konflux-go-component-dxthkn:1 konflux-konflux-test-integration-clone-ytawpu:1 konflux-python-component-jnjbhy:1 pr-branch-rdwgjk:3] No group snapshots found yet. Component snapshots may not have been processed by integration service controller yet. [FAILED] in [It] - /tmp/tmp.yfa6AEOzDs/tests/integration-service/group-snapshots-tests.go:557 @ 12/16/25 10:23:27.082 << Timeline [FAILED] Timed out after 1800.001s. Timeout while waiting for group snapshot creation Expected success, but got an error: <*errors.errorString | 0xc000210c60>: group snapshots not yet created from component snapshots { s: "group snapshots not yet created from component snapshots", } In [It] at: /tmp/tmp.yfa6AEOzDs/tests/integration-service/group-snapshots-tests.go:557 @ 12/16/25 10:23:27.082 ------------------------------ SSSSSSSS Summarizing 12 Failures: [FAIL] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path [BeforeAll] Post-release verification verifies the release CR is created [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 [FAIL] [integration-service-suite Integration Service E2E tests] with happy path for general flow of Integration service [BeforeAll] when a new Component is created triggers a build PipelineRun [integration-service] /tmp/tmp.yfa6AEOzDs/tests/integration-service/integration.go:437 [PANICKED!] [upgrade-suite Create users and check their state] [It] Verify AppStudioProvisionedUser [upgrade-verify] /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:56 [FAIL] [release-pipelines-suite FBC e2e-tests] with FBC happy path [BeforeAll] Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 [FAIL] [integration-service-suite Status Reporting of Integration tests] with status reporting of Integration tests in CheckRuns [BeforeAll] when a new Component with specified custom branch is created does not contain an annotation with a Snapshot Name [integration-service, github-status-reporting, custom-branch] /tmp/tmp.yfa6AEOzDs/tests/integration-service/integration.go:437 [FAIL] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path [BeforeAll] Post-release verification verifies if the release CR is created [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rhtap_service_push.go:119 [FAIL] [integration-service-suite Gitlab Status Reporting of Integration tests] Gitlab with status reporting of Integration tests in the assosiated merge request [BeforeAll] when a new Component with specified custom branch is created triggers a Build PipelineRun [integration-service, gitlab-status-reporting, custom-branch] /tmp/tmp.yfa6AEOzDs/tests/integration-service/gitlab-integration-reporting.go:62 [FAIL] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification [It] validate the result of task create-pyxis-image contains image ids [release-pipelines, rh-push-to-external-registry] /tmp/tmp.yfa6AEOzDs/tests/release/pipelines/rh_push_to_external_registry.go:236 [FAIL] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path [BeforeAll] Post-release verification verifies if the release CR is created [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 [FAIL] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path [BeforeAll] Post-release verification verifies if release CR is created [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.yfa6AEOzDs/tests/release/releaseLib.go:322 [FAIL] [build-service-suite Build service E2E tests] test PaC component build github when a new Component with specified custom branch is created [It] eventually leads to the PipelineRun status report at Checks tab [build-service, github-webhook, pac-build, pipeline, image-controller, build-custom-branch] /tmp/tmp.yfa6AEOzDs/tests/build/build.go:453 [FAIL] [integration-service-suite Creation of group snapshots for monorepo and multiple repos] with status reporting of Integration tests in CheckRuns when both the init PaC PRs are merged [It] get all group snapshots and check if pr-group annotation contains all components [integration-service, group-snapshot-creation] /tmp/tmp.yfa6AEOzDs/tests/integration-service/group-snapshots-tests.go:557 Ran 188 of 387 Specs in 2818.881 seconds FAIL! -- 176 Passed | 12 Failed | 34 Pending | 165 Skipped Ginkgo ran 1 suite in 48m32.264703919s Test Suite Failed Error: running "ginkgo --seed=1765877113 --timeout=1h30m0s --grace-period=30s --output-interceptor-mode=none --no-color --json-report=e2e-report.json --junit-report=e2e-report.xml --procs=20 --nodes=20 --p --output-dir=/workspace/artifact-dir ./cmd --" failed with exit code 1 make: *** [Makefile:25: ci/test/e2e] Error 1