./mage -v ci:teste2e Running target: CI:TestE2E I1027 17:00:21.611654 16381 magefile.go:529] setting up new custom bundle for testing... I1027 17:00:22.056555 16381 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761584422-hmmh -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: docker-build to image I1027 17:00:23.773832 16381 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761584422-hmmh: quay.io/redhat-appstudio-qe/test-images@sha256:2cde1cbdcc9a843c281214f85fc43773ef45d9d47b978e0cc23929ee255c90ad I1027 17:00:23.773854 16381 magefile.go:535] To use the custom docker bundle locally, run below cmd: export CUSTOM_DOCKER_BUILD_PIPELINE_BUNDLE=quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761584422-hmmh I1027 17:00:25.196784 16381 release_service_catalog.go:104] checking if repository is release-service-catalog I1027 17:00:25.196868 16381 integration_service.go:49] checking if repository is integration-service I1027 17:00:25.196890 16381 image_controller.go:49] checking if repository is image-controller I1027 17:00:25.196907 16381 build_service.go:49] checking if repository is build-service I1027 17:00:25.196923 16381 e2e_repo.go:347] checking if repository is e2e-tests I1027 17:00:25.196938 16381 e2e_repo.go:335] multi-platform tests and require sprayproxy registering are set to TRUE exec: git "diff" "--name-status" "upstream/main..HEAD" I1027 17:00:25.200611 16381 util.go:460] The following files, go.mod, go.sum, were changed! exec: go "install" "-mod=mod" "github.com/onsi/ginkgo/v2/ginkgo" go: downloading github.com/go-task/slim-sprig/v3 v3.0.0 go: downloading github.com/google/pprof v0.0.0-20241210010833-40e02aabc2ad I1027 17:00:28.452591 16381 install.go:188] cloning 'https://github.com/redhat-appstudio/infra-deployments' with git ref 'refs/heads/main' Enumerating objects: 66769, done. Counting objects: 1% (1/60) Counting objects: 3% (2/60) Counting objects: 5% (3/60) Counting objects: 6% (4/60) Counting objects: 8% (5/60) Counting objects: 10% (6/60) Counting objects: 11% (7/60) Counting objects: 13% (8/60) Counting objects: 15% (9/60) Counting objects: 16% (10/60) Counting objects: 18% (11/60) Counting objects: 20% (12/60) Counting objects: 21% (13/60) Counting objects: 23% (14/60) Counting objects: 25% (15/60) Counting objects: 26% (16/60) Counting objects: 28% (17/60) Counting objects: 30% (18/60) Counting objects: 31% (19/60) Counting objects: 33% (20/60) Counting objects: 35% (21/60) Counting objects: 36% (22/60) Counting objects: 38% (23/60) Counting objects: 40% (24/60) Counting objects: 41% (25/60) Counting objects: 43% (26/60) Counting objects: 45% (27/60) Counting objects: 46% (28/60) Counting objects: 48% (29/60) Counting objects: 50% (30/60) Counting objects: 51% (31/60) Counting objects: 53% (32/60) Counting objects: 55% (33/60) Counting objects: 56% (34/60) Counting objects: 58% (35/60) Counting objects: 60% (36/60) Counting objects: 61% (37/60) Counting objects: 63% (38/60) Counting objects: 65% (39/60) Counting objects: 66% (40/60) Counting objects: 68% (41/60) Counting objects: 70% (42/60) Counting objects: 71% (43/60) Counting objects: 73% (44/60) Counting objects: 75% (45/60) Counting objects: 76% (46/60) Counting objects: 78% (47/60) Counting objects: 80% (48/60) Counting objects: 81% (49/60) Counting objects: 83% (50/60) Counting objects: 85% (51/60) Counting objects: 86% (52/60) Counting objects: 88% (53/60) Counting objects: 90% (54/60) Counting objects: 91% (55/60) Counting objects: 93% (56/60) Counting objects: 95% (57/60) Counting objects: 96% (58/60) Counting objects: 98% (59/60) Counting objects: 100% (60/60) Counting objects: 100% (60/60), done. Compressing objects: 3% (1/32) Compressing objects: 6% (2/32) Compressing objects: 9% (3/32) Compressing objects: 12% (4/32) Compressing objects: 15% (5/32) Compressing objects: 18% (6/32) Compressing objects: 21% (7/32) Compressing objects: 25% (8/32) Compressing objects: 28% (9/32) Compressing objects: 31% (10/32) Compressing objects: 34% (11/32) Compressing objects: 37% (12/32) Compressing objects: 40% (13/32) Compressing objects: 43% (14/32) Compressing objects: 46% (15/32) Compressing objects: 50% (16/32) Compressing objects: 53% (17/32) Compressing objects: 56% (18/32) Compressing objects: 59% (19/32) Compressing objects: 62% (20/32) Compressing objects: 65% (21/32) Compressing objects: 68% (22/32) Compressing objects: 71% (23/32) Compressing objects: 75% (24/32) Compressing objects: 78% (25/32) Compressing objects: 81% (26/32) Compressing objects: 84% (27/32) Compressing objects: 87% (28/32) Compressing objects: 90% (29/32) Compressing objects: 93% (30/32) Compressing objects: 96% (31/32) Compressing objects: 100% (32/32) Compressing objects: 100% (32/32), done. Total 66769 (delta 38), reused 28 (delta 28), pack-reused 66709 (from 3) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. Installing the OpenShift GitOps operator subscription: clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created subscription.operators.coreos.com/openshift-gitops-operator created Waiting for default project (and namespace) to exist: ..................................OK Waiting for OpenShift GitOps Route: OK argocd.argoproj.io/openshift-gitops patched argocd.argoproj.io/openshift-gitops patched Switch the Route to use re-encryption argocd.argoproj.io/openshift-gitops patched Restarting ArgoCD Server pod "openshift-gitops-server-78868c5878-8lb5p" deleted Allow any authenticated users to be admin on the Argo CD instance argocd.argoproj.io/openshift-gitops patched Mark Pending PVC as Healthy, workaround for WaitForFirstConsumer StorageClasses. Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) Setting kustomize build options argocd.argoproj.io/openshift-gitops patched Setting ignore Aggregated Roles argocd.argoproj.io/openshift-gitops patched Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched Restarting GitOps server deployment.apps/openshift-gitops-server restarted ========================================================================= Argo CD URL is: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-15adc0d48c.l72d.p3.openshiftapps.com (NOTE: It may take a few moments for the route to become available) Waiting for the route: .........OK Login/password uses your OpenShift credentials ('Login with OpenShift' button) Setting secrets for Quality Dashboard namespace/quality-dashboard created secret/quality-dashboard-secrets created Creating secret for CI Helper App namespace/ci-helper-app created secret/ci-helper-app-secrets created Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation namespace/product-kubearchive-logging created Creating DB secret secret/tekton-results-database created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config secret/minio-storage-configuration created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config MinIO config already exists, skipping creation Creating Postgres TLS certs .....+.......+.....+++++++++++++++++++++++++++++++++++++++*......+++++++++++++++++++++++++++++++++++++++*.+.....+.............+..+.+...+............+.....+.........++++++ ...+++++++++++++++++++++++++++++++++++++++*..+.........+.........+.+...+......+..+...+.......+++++++++++++++++++++++++++++++++++++++*........+...+...+...............+....+..+....+..+...+.......+...+..............+.+.....+.+....................+...+...............+.....................+......+....+..+.......+......+...........+...+......................++++++ ----- Certificate request self-signature ok subject=CN=cluster.local .......+...+.......+......+...+++++++++++++++++++++++++++++++++++++++*..+...+.+..+...+.+..............+.......+........+...............+.+...+..+++++++++++++++++++++++++++++++++++++++*....+.+...+..+..........+..............+....+..+...+...++++++ ..+++++++++++++++++++++++++++++++++++++++*.............+++++++++++++++++++++++++++++++++++++++*......+......+..............+.+..+.........+..........+........+...+...+....+.....+.............+.....+............+.+.........+......+..+.......+......+..+.........+.+..+......+......+...+............+.+...........................+...+.....+............+.......+......+..+.......+......+.........+......+..+.+.....+....+..+..........+.....+....+..+...+....+.....+.....................+............+...+.+........+..................+...+.++++++ ----- Certificate request self-signature ok subject=CN=postgres-postgresql.tekton-results.svc.cluster.local secret/postgresql-tls created configmap/rds-root-crt created namespace/application-service created Creating a has secret from legacy token secret/has-github-token created Creating a secret with a token for Image Controller namespace/image-controller created secret/quaytoken created Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.wgQSwKLQg2 secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.wgQSwKLQg2 secret/docker-io-pull created serviceaccount/appstudio-pipeline created Setting secrets for Dora metrics exporter namespace/dora-metrics created secret/exporters-secret created Setting Cluster Mode: preview Switched to a new branch 'preview-main-nlif' labeling node/ip-10-0-134-68.ec2.internal... node/ip-10-0-134-68.ec2.internal labeled successfully labeled node/ip-10-0-134-68.ec2.internal labeling node/ip-10-0-144-29.ec2.internal... node/ip-10-0-144-29.ec2.internal labeled successfully labeled node/ip-10-0-144-29.ec2.internal labeling node/ip-10-0-161-94.ec2.internal... node/ip-10-0-161-94.ec2.internal labeled successfully labeled node/ip-10-0-161-94.ec2.internal verifying labels... all nodes labeled successfully. Detected OCP minor version: 17 Changing AppStudio Gitlab Org to "redhat-appstudio-qe" [preview-main-nlif 84d5455a3] Preview mode, do not merge into main 6 files changed, 12 insertions(+), 18 deletions(-) remote: remote: Create a pull request for 'preview-main-nlif' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-nlif remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-nlif -> preview-main-nlif branch 'preview-main-nlif' set up to track 'qe/preview-main-nlif'. application.argoproj.io/all-application-sets created Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/dora-metrics-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/monitoring-workload-grafana-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/has-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched build-service-in-cluster-local Synced Progressing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync build-service-in-cluster-local Synced Progressing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy squid-in-cluster-local Synced Progressing Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync monitoring-workload-prometheus-in-cluster-local OutOfSync Healthy policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync All Applications are synced and Healthy All required tekton resources are installed and ready Tekton CRDs are ready Setup Pac with existing QE sprayproxy and github App namespace/openshift-pipelines configured namespace/build-service configured namespace/integration-service configured secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created Configured pipelines-as-code-secret secret in openshift-pipelines namespace Switched to branch 'main' Your branch is up to date with 'upstream/main'. [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 104 [running]: > runtime/debug.Stack() > /usr/lib/golang/src/runtime/debug/stack.go:26 +0x5e > sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot() > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/log/log.go:60 +0xcd > sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0xc0005bd700, {0x2f940a0, 0x14}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/log/deleg.go:147 +0x3e > github.com/go-logr/logr.Logger.WithName({{0x36edb70, 0xc0005bd700}, 0x0}, {0x2f940a0?, 0x0?}) > /opt/app-root/src/go/pkg/mod/github.com/go-logr/logr@v1.4.2/logr.go:345 +0x36 > sigs.k8s.io/controller-runtime/pkg/client.newClient(0x2d71b00?, {0x0, 0xc0005c0540, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/client/client.go:129 +0xf1 > sigs.k8s.io/controller-runtime/pkg/client.New(0xc0007ba488?, {0x0, 0xc0005c0540, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/client/client.go:110 +0x7d > github.com/konflux-ci/e2e-tests/pkg/clients/kubernetes.NewAdminKubernetesClient() > /tmp/tmp.thgzXBOLY2/pkg/clients/kubernetes/client.go:157 +0xa5 > github.com/konflux-ci/e2e-tests/pkg/clients/sprayproxy.GetPaCHost() > /tmp/tmp.thgzXBOLY2/pkg/clients/sprayproxy/sprayproxy.go:93 +0x1c > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.registerPacServer() > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/repos/common.go:426 +0x78 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.init.func8(0xc000a7e488?) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/repos/common.go:378 +0x25 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.ActionFunc.Execute(0xc?, 0x2f6eb15?) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/types.go:279 +0x19 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Apply(...) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/types.go:315 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x5246200, 0xc000a7e488) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/types.go:348 +0xb3 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x523ec80?, 0xc000d8bc00?, 0x1f1bc99?}, 0xc000a7e488) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x52462c0, 0xc000a7e488) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/types.go:340 +0x2b > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x5247f40?, 0x7ff57de595c0?, 0x70?}, 0xc000a7e488) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).runLoadedCatalog(0x527d970, {0xc000d94288?, 0xc000e0de60?, 0x47?}, 0xc000a7e488) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/types.go:129 +0x119 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).RunRulesOfCategory(0x527d970, {0x2f68ec3, 0x2}, 0xc000a7e488) > /tmp/tmp.thgzXBOLY2/magefiles/rulesengine/types.go:121 +0x1b4 > main.CI.TestE2E({}) > /tmp/tmp.thgzXBOLY2/magefiles/magefile.go:330 +0x18a > main.main.func19({0x0?, 0x0?}) > /tmp/tmp.thgzXBOLY2/magefiles/mage_output_file.go:827 +0xf > main.main.func12.1() > /tmp/tmp.thgzXBOLY2/magefiles/mage_output_file.go:302 +0x5b > created by main.main.func12 in goroutine 1 > /tmp/tmp.thgzXBOLY2/magefiles/mage_output_file.go:297 +0xbe I1027 17:21:29.736428 16381 common.go:434] Registered PaC server: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-15adc0d48c.l72d.p3.openshiftapps.com I1027 17:21:29.804972 16381 common.go:459] The PaC servers registered in Sprayproxy: https://pipelines-as-code-controller-openshift-pipelines.apps.konflux-4-17-us-west-2-m8ccn.konflux-qe.devcluster.openshift.com, https://pipelines-as-code-controller-openshift-pipelines.apps.konflux-4-17-us-west-2-6krgp.konflux-qe.devcluster.openshift.com, https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-15adc0d48c.l72d.p3.openshiftapps.com I1027 17:21:29.804997 16381 common.go:475] going to create new Tekton bundle remote-build for the purpose of testing multi-platform-controller PR I1027 17:21:30.130093 16381 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.6@sha256:4a18de4811fc4b5743b0073de2154db29d323312b93419dbd28b209ce495f042 I1027 17:21:30.131966 16381 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761585689-ubsu -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I1027 17:21:31.611380 16381 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761585689-ubsu: quay.io/redhat-appstudio-qe/test-images@sha256:bc959fcdd9b7f2481af4861bb2d6994d5ca5660b5ebedd96ef1c534b627176d4 I1027 17:21:31.611401 16381 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_ARM64 to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761585689-ubsu I1027 17:21:32.084717 16381 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.6@sha256:4a18de4811fc4b5743b0073de2154db29d323312b93419dbd28b209ce495f042 I1027 17:21:32.088216 16381 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761585691-opbn -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I1027 17:21:33.798588 16381 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761585691-opbn: quay.io/redhat-appstudio-qe/test-images@sha256:827a1aef733f4f2516af87937a53ce765f36df53b9b5a327978187570eff49d2 I1027 17:21:33.798618 16381 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_S390X to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761585691-opbn I1027 17:21:34.073937 16381 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.6@sha256:4a18de4811fc4b5743b0073de2154db29d323312b93419dbd28b209ce495f042 I1027 17:21:34.075802 16381 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761585693-fubq -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I1027 17:21:35.488372 16381 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761585693-fubq: quay.io/redhat-appstudio-qe/test-images@sha256:131d8a579a0e1a1996d83c9f6bb7238579dbbf821622604b5973286e0d82ebec I1027 17:21:35.488396 16381 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_PPC64LE to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761585693-fubq exec: ginkgo "--seed=1761584421" "--timeout=1h30m0s" "--grace-period=30s" "--output-interceptor-mode=none" "--no-color" "--json-report=e2e-report.json" "--junit-report=e2e-report.xml" "--procs=20" "--nodes=20" "--p" "--output-dir=/workspace/artifact-dir" "./cmd" "--" go: downloading github.com/IBM/go-sdk-core/v5 v5.15.3 go: downloading github.com/IBM/vpc-go-sdk v0.48.0 go: downloading github.com/aws/aws-sdk-go-v2 v1.32.7 go: downloading github.com/aws/aws-sdk-go-v2/service/ec2 v1.135.0 go: downloading github.com/aws/aws-sdk-go-v2/config v1.28.7 go: downloading github.com/konflux-ci/build-service v0.0.0-20240611083846-2dee6cfe6fe4 go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.8.1 go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.17.48 go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.22 go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.24.8 go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.28.7 go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.33.3 go: downloading github.com/aws/smithy-go v1.22.1 go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.26 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.1 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.7 go: downloading github.com/go-openapi/strfmt v0.22.0 go: downloading github.com/go-playground/validator/v10 v10.17.0 go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.26 go: downloading github.com/google/go-github/v45 v45.2.0 go: downloading go.mongodb.org/mongo-driver v1.13.1 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/asaskevich/govalidator v0.0.0-20230301143203-a9d515a09cc2 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/go-openapi/errors v0.21.0 go: downloading github.com/leodido/go-urn v1.3.0 go: downloading github.com/gabriel-vasile/mimetype v1.4.3 go: downloading github.com/go-playground/universal-translator v0.18.1 go: downloading github.com/go-playground/locales v0.14.1 Running Suite: Red Hat App Studio E2E tests - /tmp/tmp.thgzXBOLY2/cmd ===================================================================== Random Seed: 1761584421 Will run 356 of 390 specs Running in parallel across 20 processes ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if release CR is created [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/release_to_github.go:139 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies the release pipelinerun is running and succeeds [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/release_to_github.go:149 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/release_to_github.go:182 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if the Release exists in github repo [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/release_to_github.go:193 ------------------------------ • [FAILED] [0.536 seconds] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path [BeforeAll] Post-release verification verifies the release CR is created [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] [BeforeAll] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/multiarch_advisories.go:61 [It] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/multiarch_advisories.go:113 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 @ 10/27/25 17:23:21.945 [PANICKED] in [AfterAll] - /usr/lib/golang/src/runtime/panic.go:262 @ 10/27/25 17:23:21.945 << Timeline [FAILED] Unexpected error: <*url.Error | 0xc000c9c240>: Get "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/managed-release-team/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host { Op: "Get", URL: "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/managed-release-team/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis", Err: <*net.OpError | 0xc000c20870>{ Op: "dial", Net: "tcp", Source: nil, Addr: nil, Err: <*net.DNSError | 0xc000c206e0>{ UnwrapErr: nil, Err: "no such host", Name: "api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com", Server: "172.30.0.10:53", IsTimeout: false, IsTemporary: false, IsNotFound: true, }, }, } occurred In [BeforeAll] at: /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 @ 10/27/25 17:23:21.945 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSS ------------------------------ • [FAILED] [0.441 seconds] [release-pipelines-suite FBC e2e-tests] with FBC happy path [BeforeAll] Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHappyPath] [BeforeAll] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/fbc_release.go:89 [It] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/fbc_release.go:123 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 @ 10/27/25 17:23:21.958 [PANICKED] in [AfterAll] - /usr/lib/golang/src/runtime/panic.go:262 @ 10/27/25 17:23:21.958 << Timeline [FAILED] Unexpected error: <*url.Error | 0xc000818e70>: Get "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/managed-release-team/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host { Op: "Get", URL: "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/managed-release-team/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis", Err: <*net.OpError | 0xc000c9e960>{ Op: "dial", Net: "tcp", Source: nil, Addr: nil, Err: <*net.DNSError | 0xc000cb65f0>{ UnwrapErr: nil, Err: "no such host", Name: "api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com", Server: "172.30.0.10:53", IsTimeout: false, IsTemporary: false, IsNotFound: true, }, }, } occurred In [BeforeAll] at: /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 @ 10/27/25 17:23:21.958 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSSSSSSSSSSSSSS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-host-pool] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:120 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-host-pool] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:124 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-host-pool] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:127 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-host-pool] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:148 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created test that cleanup happened successfully [multi-platform, aws-host-pool] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:152 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:251 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:255 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:259 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:263 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, aws-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:267 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmz-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:341 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmz-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:345 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmz-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:349 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmz-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:353 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmz-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:357 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmp-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:432 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmp-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:436 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmp-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:440 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmp-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:444 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmp-dynamic] /tmp/tmp.thgzXBOLY2/tests/build/multi-platform.go:448 ------------------------------ • [FAILED] [4.278 seconds] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path [BeforeAll] Post-release verification verifies if the release CR is created [release-pipelines, rhtap-service-push, RhtapServicePush] [BeforeAll] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rhtap_service_push.go:75 [It] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rhtap_service_push.go:150 Timeline >> PR #3563 got created with sha 239273179a935641e0eb4bbacc860b5d8afa6c69 merged result sha: 9a51081c64b888418deb1a062e234b949e243de1 for PR #3563 [FAILED] in [BeforeAll] - /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rhtap_service_push.go:119 @ 10/27/25 17:23:25.374 [PANICKED] in [AfterAll] - /usr/lib/golang/src/runtime/panic.go:262 @ 10/27/25 17:23:25.374 << Timeline [FAILED] Unexpected error: <*fmt.wrapError | 0xc000eeaa60>: failed to get API group resources: unable to retrieve the complete list of server APIs: appstudio.redhat.com/v1alpha1: Get "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/dev-release-team/apis/appstudio.redhat.com/v1alpha1": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host { msg: "failed to get API group resources: unable to retrieve the complete list of server APIs: appstudio.redhat.com/v1alpha1: Get \"https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/dev-release-team/apis/appstudio.redhat.com/v1alpha1\": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host", err: <*apiutil.ErrResourceDiscoveryFailed | 0xc000742498>{ { Group: "appstudio.redhat.com", Version: "v1alpha1", }: <*url.Error | 0xc0019465a0>{ Op: "Get", URL: "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/dev-release-team/apis/appstudio.redhat.com/v1alpha1", Err: <*net.OpError | 0xc0009aeaf0>{ Op: "dial", Net: "tcp", Source: nil, Addr: nil, Err: <*net.DNSError | 0xc000dc64b0>{ UnwrapErr: nil, Err: "no such host", Name: "api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com", Server: "172.30.0.10:53", IsTimeout: false, IsTemporary: false, IsNotFound: true, }, }, }, }, } occurred In [BeforeAll] at: /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rhtap_service_push.go:119 @ 10/27/25 17:23:25.374 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSS•• ------------------------------ • [FAILED] [0.400 seconds] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path [BeforeAll] Post-release verification verifies if release CR is created [release-pipelines, rh-advisories, rhAdvisories] [BeforeAll] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rh_advisories.go:61 [It] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rh_advisories.go:118 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 @ 10/27/25 17:23:28.536 [PANICKED] in [AfterAll] - /usr/lib/golang/src/runtime/panic.go:262 @ 10/27/25 17:23:28.537 << Timeline [FAILED] Unexpected error: <*url.Error | 0xc00170b500>: Get "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/managed-release-team/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host { Op: "Get", URL: "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/managed-release-team/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis", Err: <*net.OpError | 0xc000e36fa0>{ Op: "dial", Net: "tcp", Source: nil, Addr: nil, Err: <*net.DNSError | 0xc000e36e10>{ UnwrapErr: nil, Err: "no such host", Name: "api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com", Server: "172.30.0.10:53", IsTimeout: false, IsTemporary: false, IsNotFound: true, }, }, } occurred In [BeforeAll] at: /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 @ 10/27/25 17:23:28.536 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSS ------------------------------ • [FAILED] [0.871 seconds] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path [BeforeAll] Post-release verification verifies if the release CR is created [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] [BeforeAll] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rh_push_to_registry_redhat_io.go:61 [It] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rh_push_to_registry_redhat_io.go:110 Timeline >> [FAILED] in [BeforeAll] - /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 @ 10/27/25 17:23:29.005 [PANICKED] in [AfterAll] - /usr/lib/golang/src/runtime/panic.go:262 @ 10/27/25 17:23:29.409 << Timeline [FAILED] Unexpected error: <*url.Error | 0xc001ba39e0>: Get "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/managed-release-team/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis": dial tcp: lookup api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com on 172.30.0.10:53: no such host { Op: "Get", URL: "https://api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com/workspaces/managed-release-team/api/v1/namespaces/managed-release-team-tenant/secrets/pyxis", Err: <*net.OpError | 0xc0005c24b0>{ Op: "dial", Net: "tcp", Source: nil, Addr: nil, Err: <*net.DNSError | 0xc000d805f0>{ UnwrapErr: nil, Err: "no such host", Name: "api-toolchain-host-operator.apps.stone-stg-host.qc0p.p1.openshiftapps.com", Server: "172.30.0.10:53", IsTimeout: false, IsTemporary: false, IsNotFound: true, }, }, } occurred In [BeforeAll] at: /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 @ 10/27/25 17:23:29.005 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSS ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context points to a file [build-templates] /tmp/tmp.thgzXBOLY2/tests/build/tkn-bundle.go:177 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles from specific context [build-templates] /tmp/tmp.thgzXBOLY2/tests/build/tkn-bundle.go:188 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context is the root directory [build-templates] /tmp/tmp.thgzXBOLY2/tests/build/tkn-bundle.go:198 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when context points to a file and a directory [build-templates] /tmp/tmp.thgzXBOLY2/tests/build/tkn-bundle.go:207 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when using negation [build-templates] /tmp/tmp.thgzXBOLY2/tests/build/tkn-bundle.go:217 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding HOME environment variable [build-templates] /tmp/tmp.thgzXBOLY2/tests/build/tkn-bundle.go:227 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding STEP image [build-templates] /tmp/tmp.thgzXBOLY2/tests/build/tkn-bundle.go:236 ------------------------------ •••••••••••••••••••• ------------------------------ • [PANICKED] [152.158 seconds] [upgrade-suite Create users and check their state] [It] Verify AppStudioProvisionedUser [upgrade-verify] /tmp/tmp.thgzXBOLY2/tests/upgrade/verifyWorkload.go:20 Timeline >> "msg"="Observed a panic: \"invalid memory address or nil pointer dereference\" (runtime error: invalid memory address or nil pointer dereference)\ngoroutine 469 [running]:\nk8s.io/apimachinery/pkg/util/runtime.logPanic({0x2c41da0, 0x53f1340})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:75 +0x85\nk8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc001880e00?})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:49 +0x65\npanic({0x2c41da0?, 0x53f1340?})\n\t/usr/lib/golang/src/runtime/panic.go:792 +0x132\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp.func1()\n\t/tmp/tmp.thgzXBOLY2/pkg/sandbox/sandbox.go:329 +0x35\ngithub.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval.func1({0xee6b2800?, 0x0?})\n\t/tmp/tmp.thgzXBOLY2/pkg/utils/util.go:138 +0x13\nk8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1(0xc000cf15a0?, {0x383c2a8?, 0xc0004c3340?})\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/loop.go:53 +0x52\nk8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext({0x383c2a8, 0xc0004c3340}, {0x3830d70, 0xc000cf15a0}, 0x1, 0x0, 0xc000b09e68)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/loop.go:54 +0x115\nk8s.io/apimachinery/pkg/util/wait.PollUntilContextTimeout({0x383c158?, 0x54a74c0?}, 0xee6b2800, 0x419be5?, 0x1, 0xc000b09e68)\n\t/opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/poll.go:48 +0xa5\ngithub.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval(0xa?, 0xc00152f6b0?, 0x1?)\n\t/tmp/tmp.thgzXBOLY2/pkg/utils/util.go:138 +0x45\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp(0x322977b?, {0x322977b?, 0x32263c5?}, 0x8?)\n\t/tmp/tmp.thgzXBOLY2/pkg/sandbox/sandbox.go:328 +0x72\ngithub.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreated(0x0, {0x322977b, 0x9})\n\t/tmp/tmp.thgzXBOLY2/pkg/sandbox/sandbox.go:324 +0x4b\ngithub.com/konflux-ci/e2e-tests/tests/upgrade/verify.VerifyAppStudioProvisionedUser(0x0?)\n\t/tmp/tmp.thgzXBOLY2/tests/upgrade/verify/verifyUsers.go:14 +0x25\ngithub.com/konflux-ci/e2e-tests/tests/upgrade.init.func1.2()\n\t/tmp/tmp.thgzXBOLY2/tests/upgrade/verifyWorkload.go:21 +0x1a\ngithub.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0x7c2976?, 0xc001713e00?})\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.22.2/internal/node.go:475 +0x13\ngithub.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.22.2/internal/suite.go:894 +0x7b\ncreated by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 45\n\t/opt/app-root/src/go/pkg/mod/github.com/onsi/ginkgo/v2@v2.22.2/internal/suite.go:881 +0xd7b" "error"=null [PANICKED] in [It] - /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:56 @ 10/27/25 17:26:01.57 << Timeline [PANICKED] Test Panicked In [It] at: /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:56 @ 10/27/25 17:26:01.57 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc001880e00?}) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:56 +0xc7 panic({0x2c41da0?, 0x53f1340?}) /usr/lib/golang/src/runtime/panic.go:792 +0x132 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp.func1() /tmp/tmp.thgzXBOLY2/pkg/sandbox/sandbox.go:329 +0x35 github.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval.func1({0xee6b2800?, 0x0?}) /tmp/tmp.thgzXBOLY2/pkg/utils/util.go:138 +0x13 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1(0xc000cf15a0?, {0x383c2a8?, 0xc0004c3340?}) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/loop.go:53 +0x52 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext({0x383c2a8, 0xc0004c3340}, {0x3830d70, 0xc000cf15a0}, 0x1, 0x0, 0xc001983e68) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/loop.go:54 +0x115 k8s.io/apimachinery/pkg/util/wait.PollUntilContextTimeout({0x383c158?, 0x54a74c0?}, 0xee6b2800, 0x419be5?, 0x1, 0xc000b09e68) /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/wait/poll.go:48 +0xa5 github.com/konflux-ci/e2e-tests/pkg/utils.WaitUntilWithInterval(0xa?, 0xc00152f6b0?, 0x1?) /tmp/tmp.thgzXBOLY2/pkg/utils/util.go:138 +0x45 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreatedWithSignUp(0x322977b?, {0x322977b?, 0x32263c5?}, 0x8?) /tmp/tmp.thgzXBOLY2/pkg/sandbox/sandbox.go:328 +0x72 github.com/konflux-ci/e2e-tests/pkg/sandbox.(*SandboxController).CheckUserCreated(0x0, {0x322977b, 0x9}) /tmp/tmp.thgzXBOLY2/pkg/sandbox/sandbox.go:324 +0x4b github.com/konflux-ci/e2e-tests/tests/upgrade/verify.VerifyAppStudioProvisionedUser(0x0?) /tmp/tmp.thgzXBOLY2/tests/upgrade/verify/verifyUsers.go:14 +0x25 github.com/konflux-ci/e2e-tests/tests/upgrade.init.func1.2() /tmp/tmp.thgzXBOLY2/tests/upgrade/verifyWorkload.go:21 +0x1a ------------------------------ SS••••••••••••••••••••••••••••••••••••••••• ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test build secret lookup when two secrets are created when second component is deleted, pac pr branch should not exist in the repo [build-service, pac-build, secret-lookup] /tmp/tmp.thgzXBOLY2/tests/build/build.go:1118 ------------------------------ ••••••••••••••••• ------------------------------ • [FAILED] [396.507 seconds] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification [It] verifies a release PipelineRun is started and succeeded in managed namespace [release-pipelines, rh-push-to-external-registry] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rh_push_to_external_registry.go:226 Timeline >> PipelineRun has not been created yet for release %s/%s push-pyxis-ptbb snapshot-sample-zfso-gkdq5 PipelineRun has not been created yet for release %s/%s push-pyxis-ptbb snapshot-sample-zfso-gkdq5 PipelineRun has not been created yet for release %s/%s push-pyxis-ptbb snapshot-sample-zfso-gkdq5 PipelineRun has not been created yet for release %s/%s push-pyxis-ptbb snapshot-sample-zfso-gkdq5 PipelineRun has not been created yet for release %s/%s push-pyxis-ptbb snapshot-sample-zfso-gkdq5 PipelineRun has not been created yet for release %s/%s push-pyxis-ptbb snapshot-sample-zfso-gkdq5 PipelineRun has not been created yet for release %s/%s push-pyxis-ptbb snapshot-sample-zfso-gkdq5 PipelineRun has not been created yet for release %s/%s push-pyxis-ptbb snapshot-sample-zfso-gkdq5 PipelineRun managed-p7zfd reason: ResolvingPipelineRef PipelineRun managed-p7zfd reason: ResolvingTaskRef PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Running PipelineRun managed-p7zfd reason: Failed [FAILED] in [It] - /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rh_push_to_external_registry.go:230 @ 10/27/25 17:32:52.201 << Timeline [FAILED] Error when waiting for a release pipelinerun for release push-pyxis-ptbb/snapshot-sample-zfso-gkdq5 to finish Expected success, but got an error: <*errors.errorString | 0xc0011fc5e0>: Pipelinerun 'managed-p7zfd' didn't succeed Logs from failed container 'managed-p7zfd-push-rpm-data-to-pyxis/step-create-trusted-artifact': 2025/10/27 17:32:37 Skipping step because a previous step failed { s: "Pipelinerun 'managed-p7zfd' didn't succeed\nLogs from failed container 'managed-p7zfd-push-rpm-data-to-pyxis/step-create-trusted-artifact': \n2025/10/27 17:32:37 Skipping step because a previous step failed\n", } In [It] at: /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rh_push_to_external_registry.go:230 @ 10/27/25 17:32:52.201 ------------------------------ SSS•••••••••••••••S••S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.thgzXBOLY2/tests/build/build_templates.go:489 ------------------------------ •••••••••••••••S••••••••••••••••••••••••••••••••••••••S•S• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build-oci-ta should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.thgzXBOLY2/tests/build/build_templates.go:489 ------------------------------ •••••••S••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• ------------------------------ • [FAILED] [14.723 seconds] [integration-service-suite Creation of group snapshots for monorepo and multiple repos] with status reporting of Integration tests in CheckRuns when both the init PaC PRs are merged [It] wait for the last components build to finish [integration-service, group-snapshot-creation] /tmp/tmp.thgzXBOLY2/tests/integration-service/group-snapshots-tests.go:477 Timeline >> PipelineRun go-component-ldlahl-on-pull-request-cdkqf reason: Completed PipelineRun integration-resolver-pipelinerun-2mx85 reason: Succeeded PipelineRun integration-resolver-pipelinerun-bjsvs reason: Running PipelineRun integration-resolver-pipelinerun-bjsvs reason: Cancelled attempt 1/3: PipelineRun "integration-resolver-pipelinerun-bjsvs" failed: PipelineRun integration-resolver-pipelinerun-bjsvs reason: Cancelled an error happened during storing pipelineRun log group-hlse:integration-resolver-pipelinerun-bjsvs: container "prepare" in pod "konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod" is waiting to start: PodInitializing failed to get logs for PipelineRun group-hlse:integration-resolver-pipelinerun-bjsvs: container "place-scripts" in pod "konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod" is waiting to start: PodInitializing attempt 2/3: PipelineRun "integration-resolver-pipelinerun-bjsvs" failed: pod: konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod | init container: prepare 2025/10/27 17:42:52 Entrypoint initialization pod: konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod | init container: place-scripts PipelineRun integration-resolver-pipelinerun-bjsvs reason: Cancelled an error happened during storing pipelineRun log group-hlse:integration-resolver-pipelinerun-bjsvs: container "place-scripts" in pod "konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod" is waiting to start: PodInitializing failed to get logs for PipelineRun group-hlse:integration-resolver-pipelinerun-bjsvs: container "place-scripts" in pod "konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod" is waiting to start: PodInitializing attempt 3/3: PipelineRun "integration-resolver-pipelinerun-bjsvs" failed: pod: konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod | init container: prepare 2025/10/27 17:42:52 Entrypoint initialization pod: konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod | init container: place-scripts [FAILED] in [It] - /tmp/tmp.thgzXBOLY2/tests/integration-service/group-snapshots-tests.go:481 @ 10/27/25 17:42:53.307 << Timeline [FAILED] Expected success, but got an error: <*errors.errorString | 0xc001144ff0>: pod: konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod | init container: prepare 2025/10/27 17:42:52 Entrypoint initialization pod: konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod | init container: place-scripts { s: "\n pod: konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod | init container: prepare\n2025/10/27 17:42:52 Entrypoint initialization\n\n pod: konflux-test-integration-clone-cxtoeq-on-push-qqsck-init-pod | init container: place-scripts\n", } In [It] at: /tmp/tmp.thgzXBOLY2/tests/integration-service/group-snapshots-tests.go:481 @ 10/27/25 17:42:53.307 ------------------------------ SSSSSSSSSS••••••••••••••••••••••••••••••••••••••••••••••••••••••• Summarizing 8 Failures: [FAIL] [release-pipelines-suite e2e tests for rh-advisories pipeline] Rh-advisories happy path [BeforeAll] Post-release verification verifies if release CR is created [release-pipelines, rh-advisories, rhAdvisories] /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 [FAIL] [release-pipelines-suite e2e tests for rh-push-to-redhat-io pipeline] Rh-push-to-redhat-io happy path [BeforeAll] Post-release verification verifies if the release CR is created [release-pipelines, rh-push-to-registry-redhat-io, PushToRedhatIO] /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 [PANICKED!] [upgrade-suite Create users and check their state] [It] Verify AppStudioProvisionedUser [upgrade-verify] /opt/app-root/src/go/pkg/mod/k8s.io/apimachinery@v0.29.4/pkg/util/runtime/runtime.go:56 [FAIL] [release-pipelines-suite [HACBS-1571]test-release-e2e-push-image-to-pyxis] Post-release verification [It] verifies a release PipelineRun is started and succeeded in managed namespace [release-pipelines, rh-push-to-external-registry] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rh_push_to_external_registry.go:230 [FAIL] [release-pipelines-suite FBC e2e-tests] with FBC happy path [BeforeAll] Post-release verification creates component from git source https://github.com/redhat-appstudio-qe/fbc-sample-repo-test [release-pipelines, fbc-release, fbcHappyPath] /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 [FAIL] [release-pipelines-suite e2e tests for multi arch with rh-advisories pipeline] Multi arch test happy path [BeforeAll] Post-release verification verifies the release CR is created [release-pipelines, rh-advisories, multiarch-advisories, multiArchAdvisories] /tmp/tmp.thgzXBOLY2/tests/release/releaseLib.go:323 [FAIL] [integration-service-suite Creation of group snapshots for monorepo and multiple repos] with status reporting of Integration tests in CheckRuns when both the init PaC PRs are merged [It] wait for the last components build to finish [integration-service, group-snapshot-creation] /tmp/tmp.thgzXBOLY2/tests/integration-service/group-snapshots-tests.go:481 [FAIL] [release-pipelines-suite e2e tests for rhtap-service-push pipeline] Rhtap-service-push happy path [BeforeAll] Post-release verification verifies if the release CR is created [release-pipelines, rhtap-service-push, RhtapServicePush] /tmp/tmp.thgzXBOLY2/tests/release/pipelines/rhtap_service_push.go:119 Ran 308 of 390 Specs in 2054.102 seconds FAIL! -- 300 Passed | 8 Failed | 34 Pending | 48 Skipped Ginkgo ran 1 suite in 35m59.56161397s Test Suite Failed Error: running "ginkgo --seed=1761584421 --timeout=1h30m0s --grace-period=30s --output-interceptor-mode=none --no-color --json-report=e2e-report.json --junit-report=e2e-report.xml --procs=20 --nodes=20 --p --output-dir=/workspace/artifact-dir ./cmd --" failed with exit code 1 make: *** [Makefile:25: ci/test/e2e] Error 1