./mage -v ci:teste2e Running target: CI:TestE2E I1022 11:10:09.967268 16387 magefile.go:521] setting up new custom bundle for testing... I1022 11:10:10.312041 16387 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761131410-cigb -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: docker-build to image I1022 11:10:11.684850 16387 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761131410-cigb: quay.io/redhat-appstudio-qe/test-images@sha256:0c5da81bf454ee4d8ddcf553be3c3e51a50ca479221dee19e9c107d566694f86 I1022 11:10:11.684873 16387 magefile.go:527] To use the custom docker bundle locally, run below cmd: export CUSTOM_DOCKER_BUILD_PIPELINE_BUNDLE=quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761131410-cigb I1022 11:10:12.784390 16387 release_service_catalog.go:104] checking if repository is release-service-catalog I1022 11:10:12.784412 16387 integration_service.go:49] checking if repository is integration-service I1022 11:10:12.784418 16387 image_controller.go:49] checking if repository is image-controller I1022 11:10:12.784424 16387 build_service.go:49] checking if repository is build-service I1022 11:10:12.784429 16387 e2e_repo.go:347] checking if repository is e2e-tests I1022 11:10:12.784431 16387 e2e_repo.go:335] multi-platform tests and require sprayproxy registering are set to TRUE exec: git "diff" "--name-status" "upstream/main..HEAD" I1022 11:10:12.787295 16387 util.go:460] The following files, integration-tests/pipelines/konflux-e2e-tests-pipeline.yaml, were changed! exec: go "install" "-mod=mod" "github.com/onsi/ginkgo/v2/ginkgo" go: downloading github.com/google/pprof v0.0.0-20241210010833-40e02aabc2ad go: downloading github.com/go-task/slim-sprig/v3 v3.0.0 I1022 11:10:16.558364 16387 install.go:188] cloning 'https://github.com/redhat-appstudio/infra-deployments' with git ref 'refs/heads/main' Enumerating objects: 66414, done. Counting objects: 0% (1/125) Counting objects: 1% (2/125) Counting objects: 2% (3/125) Counting objects: 3% (4/125) Counting objects: 4% (5/125) Counting objects: 5% (7/125) Counting objects: 6% (8/125) Counting objects: 7% (9/125) Counting objects: 8% (10/125) Counting objects: 9% (12/125) Counting objects: 10% (13/125) Counting objects: 11% (14/125) Counting objects: 12% (15/125) Counting objects: 13% (17/125) Counting objects: 14% (18/125) Counting objects: 15% (19/125) Counting objects: 16% (20/125) Counting objects: 17% (22/125) Counting objects: 18% (23/125) Counting objects: 19% (24/125) Counting objects: 20% (25/125) Counting objects: 21% (27/125) Counting objects: 22% (28/125) Counting objects: 23% (29/125) Counting objects: 24% (30/125) Counting objects: 25% (32/125) Counting objects: 26% (33/125) Counting objects: 27% (34/125) Counting objects: 28% (35/125) Counting objects: 29% (37/125) Counting objects: 30% (38/125) Counting objects: 31% (39/125) Counting objects: 32% (40/125) Counting objects: 33% (42/125) Counting objects: 34% (43/125) Counting objects: 35% (44/125) Counting objects: 36% (45/125) Counting objects: 37% (47/125) Counting objects: 38% (48/125) Counting objects: 39% (49/125) Counting objects: 40% (50/125) Counting objects: 41% (52/125) Counting objects: 42% (53/125) Counting objects: 43% (54/125) Counting objects: 44% (55/125) Counting objects: 45% (57/125) Counting objects: 46% (58/125) Counting objects: 47% (59/125) Counting objects: 48% (60/125) Counting objects: 49% (62/125) Counting objects: 50% (63/125) Counting objects: 51% (64/125) Counting objects: 52% (65/125) Counting objects: 53% (67/125) Counting objects: 54% (68/125) Counting objects: 55% (69/125) Counting objects: 56% (70/125) Counting objects: 57% (72/125) Counting objects: 58% (73/125) Counting objects: 59% (74/125) Counting objects: 60% (75/125) Counting objects: 61% (77/125) Counting objects: 62% (78/125) Counting objects: 63% (79/125) Counting objects: 64% (80/125) Counting objects: 65% (82/125) Counting objects: 66% (83/125) Counting objects: 67% (84/125) Counting objects: 68% (85/125) Counting objects: 69% (87/125) Counting objects: 70% (88/125) Counting objects: 71% (89/125) Counting objects: 72% (90/125) Counting objects: 73% (92/125) Counting objects: 74% (93/125) Counting objects: 75% (94/125) Counting objects: 76% (95/125) Counting objects: 77% (97/125) Counting objects: 78% (98/125) Counting objects: 79% (99/125) Counting objects: 80% (100/125) Counting objects: 81% (102/125) Counting objects: 82% (103/125) Counting objects: 83% (104/125) Counting objects: 84% (105/125) Counting objects: 85% (107/125) Counting objects: 86% (108/125) Counting objects: 87% (109/125) Counting objects: 88% (110/125) Counting objects: 89% (112/125) Counting objects: 90% (113/125) Counting objects: 91% (114/125) Counting objects: 92% (115/125) Counting objects: 93% (117/125) Counting objects: 94% (118/125) Counting objects: 95% (119/125) Counting objects: 96% (120/125) Counting objects: 97% (122/125) Counting objects: 98% (123/125) Counting objects: 99% (124/125) Counting objects: 100% (125/125) Counting objects: 100% (125/125), done. Compressing objects: 1% (1/77) Compressing objects: 2% (2/77) Compressing objects: 3% (3/77) Compressing objects: 5% (4/77) Compressing objects: 6% (5/77) Compressing objects: 7% (6/77) Compressing objects: 9% (7/77) Compressing objects: 10% (8/77) Compressing objects: 11% (9/77) Compressing objects: 12% (10/77) Compressing objects: 14% (11/77) Compressing objects: 15% (12/77) Compressing objects: 16% (13/77) Compressing objects: 18% (14/77) Compressing objects: 19% (15/77) Compressing objects: 20% (16/77) Compressing objects: 22% (17/77) Compressing objects: 23% (18/77) Compressing objects: 24% (19/77) Compressing objects: 25% (20/77) Compressing objects: 27% (21/77) Compressing objects: 28% (22/77) Compressing objects: 29% (23/77) Compressing objects: 31% (24/77) Compressing objects: 32% (25/77) Compressing objects: 33% (26/77) Compressing objects: 35% (27/77) Compressing objects: 36% (28/77) Compressing objects: 37% (29/77) Compressing objects: 38% (30/77) Compressing objects: 40% (31/77) Compressing objects: 41% (32/77) Compressing objects: 42% (33/77) Compressing objects: 44% (34/77) Compressing objects: 45% (35/77) Compressing objects: 46% (36/77) Compressing objects: 48% (37/77) Compressing objects: 49% (38/77) Compressing objects: 50% (39/77) Compressing objects: 51% (40/77) Compressing objects: 53% (41/77) Compressing objects: 54% (42/77) Compressing objects: 55% (43/77) Compressing objects: 57% (44/77) Compressing objects: 58% (45/77) Compressing objects: 59% (46/77) Compressing objects: 61% (47/77) Compressing objects: 62% (48/77) Compressing objects: 63% (49/77) Compressing objects: 64% (50/77) Compressing objects: 66% (51/77) Compressing objects: 67% (52/77) Compressing objects: 68% (53/77) Compressing objects: 70% (54/77) Compressing objects: 71% (55/77) Compressing objects: 72% (56/77) Compressing objects: 74% (57/77) Compressing objects: 75% (58/77) Compressing objects: 76% (59/77) Compressing objects: 77% (60/77) Compressing objects: 79% (61/77) Compressing objects: 80% (62/77) Compressing objects: 81% (63/77) Compressing objects: 83% (64/77) Compressing objects: 84% (65/77) Compressing objects: 85% (66/77) Compressing objects: 87% (67/77) Compressing objects: 88% (68/77) Compressing objects: 89% (69/77) Compressing objects: 90% (70/77) Compressing objects: 92% (71/77) Compressing objects: 93% (72/77) Compressing objects: 94% (73/77) Compressing objects: 96% (74/77) Compressing objects: 97% (75/77) Compressing objects: 98% (76/77) Compressing objects: 100% (77/77) Compressing objects: 100% (77/77), done. Total 66414 (delta 76), reused 67 (delta 46), pack-reused 66289 (from 4) From https://github.com/redhat-appstudio/infra-deployments * branch main -> FETCH_HEAD Already up to date. Installing the OpenShift GitOps operator subscription: clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrole.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-application-controller created clusterrolebinding.rbac.authorization.k8s.io/appstudio-openshift-gitops-argocd-server created subscription.operators.coreos.com/openshift-gitops-operator created Waiting for default project (and namespace) to exist: ........................................OK Waiting for OpenShift GitOps Route: OK argocd.argoproj.io/openshift-gitops patched argocd.argoproj.io/openshift-gitops patched Switch the Route to use re-encryption argocd.argoproj.io/openshift-gitops patched Restarting ArgoCD Server pod "openshift-gitops-server-78868c5878-sbr2b" deleted Allow any authenticated users to be admin on the Argo CD instance argocd.argoproj.io/openshift-gitops patched Mark Pending PVC as Healthy, workaround for WaitForFirstConsumer StorageClasses. Warning: unknown field "spec.resourceCustomizations" argocd.argoproj.io/openshift-gitops patched (no change) Setting kustomize build options argocd.argoproj.io/openshift-gitops patched Setting ignore Aggregated Roles argocd.argoproj.io/openshift-gitops patched Setting ArgoCD tracking method to annotation argocd.argoproj.io/openshift-gitops patched Restarting GitOps server deployment.apps/openshift-gitops-server restarted ========================================================================= Argo CD URL is: https://openshift-gitops-server-openshift-gitops.apps.rosa.kx-2d7e05980f.tn5s.p3.openshiftapps.com (NOTE: It may take a few moments for the route to become available) Waiting for the route: ..........OK Login/password uses your OpenShift credentials ('Login with OpenShift' button) Setting secrets for Quality Dashboard namespace/quality-dashboard created secret/quality-dashboard-secrets created Creating secret for CI Helper App namespace/ci-helper-app created secret/ci-helper-app-secrets created [WARN] Namespace 'image-controller' does not exist. Creating it... namespace/image-controller created secret/sealights-token created [INFO] Secret 'sealights-token' has been created/updated in namespace 'image-controller'. [WARN] Namespace 'integration-service' does not exist. Creating it... namespace/integration-service created secret/sealights-token created [INFO] Secret 'sealights-token' has been created/updated in namespace 'integration-service'. [WARN] Namespace 'release-service' does not exist. Creating it... namespace/release-service created secret/sealights-token created [INFO] Secret 'sealights-token' has been created/updated in namespace 'release-service'. [WARN] Namespace 'build-service' does not exist. Creating it... namespace/build-service created secret/sealights-token created [INFO] Secret 'sealights-token' has been created/updated in namespace 'build-service'. Setting secrets for pipeline-service tekton-results namespace already exists, skipping creation tekton-logging namespace already exists, skipping creation namespace/product-kubearchive-logging created Creating DB secret secret/tekton-results-database created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config secret/minio-storage-configuration created Creating S3 secret secret/tekton-results-s3 created Creating MinIO config MinIO config already exists, skipping creation Creating Postgres TLS certs ....+++++++++++++++++++++++++++++++++++++++*...........+.+..+..........+...+..............+.+..............+....+......+...+........+.........+.+..+.+......+++++++++++++++++++++++++++++++++++++++*.............+...+............+..+.+.........+.....+.+..+...+.+...............+..............+.+........+...+............+......+.......+............+........+.......+..+....+.........+...............+...+........+......+....+.....+....+.....+...+...+.+..................+.....+.......+.........+......+......+..+...+....+.....+.+........+.........+...+.........+.+.....+....+...+........+..........+...+..+.........+.........+..........+......+.....+..........+.........+..+.........+......+.......++++++ ....+.....+.+......+.....+++++++++++++++++++++++++++++++++++++++*......+....+...+........+.......+.....+.+......+.....+.+...+..+...+.......+.........+.........+++++++++++++++++++++++++++++++++++++++*.+...+.......+..+.+.........+..+.........+....+...+........+.......+...+.....+......+......+...+.........+...+....+...+........+.......+............+...+..+.............+...........+....+...+..+.+......+.........+.....+......+.+.........+...+..+.+...................................+....+...........+....+...+..+....+......+...........+..........+............+..+...................+...........+...+...+...+..........+..+............+.+...............+......+...........+....+......+.....+.......+..+....+.........+......+..+....+...+.....+.+..+...+....+.....+................+..+........................+.+............+...+..................+.....+....+...+..+.+..+.........+................+...+..+..................+.+.....+.+.....+.......+..+......+.......+......+..+....+...+...+..+...+...+.+..............+......+...............+.+..+.......+...+..+......+...+......+...+.+..+....+........+.+..+............+.+......+...+.....+............+...+.......+........+......+.++++++ ----- Certificate request self-signature ok subject=CN=cluster.local ..+.........+++++++++++++++++++++++++++++++++++++++*.............+............+......+........+....+...+..+.+............+++++++++++++++++++++++++++++++++++++++*..+.....+...+..........+..+.............++++++ .......+.....+.........+.+.........+......+.........+.....+..........+..+.......+..+.+..+...+.......+..+......+...............+++++++++++++++++++++++++++++++++++++++*.+....+++++++++++++++++++++++++++++++++++++++*..........+.........+..+.........+......+....++++++ ----- Certificate request self-signature ok subject=CN=postgres-postgresql.tekton-results.svc.cluster.local secret/postgresql-tls created configmap/rds-root-crt created namespace/application-service created Creating a has secret from legacy token secret/has-github-token created Creating a secret with a token for Image Controller Warning: resource namespaces/image-controller is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically. namespace/image-controller configured secret/quaytoken created Configuring the cluster with a pull secret for Docker Hub Saved credentials for docker.io into /tmp/tmp.EnV2zlQPiW secret/pull-secret data updated Saved credentials for docker.io into /tmp/tmp.EnV2zlQPiW secret/docker-io-pull created serviceaccount/appstudio-pipeline created Setting secrets for Dora metrics exporter namespace/dora-metrics created secret/exporters-secret created Setting Cluster Mode: preview Switched to a new branch 'preview-main-jnav' labeling node/ip-10-0-137-38.ec2.internal... node/ip-10-0-137-38.ec2.internal labeled successfully labeled node/ip-10-0-137-38.ec2.internal labeling node/ip-10-0-146-13.ec2.internal... node/ip-10-0-146-13.ec2.internal labeled successfully labeled node/ip-10-0-146-13.ec2.internal labeling node/ip-10-0-163-9.ec2.internal... node/ip-10-0-163-9.ec2.internal labeled successfully labeled node/ip-10-0-163-9.ec2.internal verifying labels... all nodes labeled successfully. Detected OCP minor version: 17 Changing AppStudio Gitlab Org to "redhat-appstudio-qe" [preview-main-jnav eec45f671] Preview mode, do not merge into main 6 files changed, 12 insertions(+), 18 deletions(-) remote: remote: Create a pull request for 'preview-main-jnav' on GitHub by visiting: remote: https://github.com/redhat-appstudio-qe/infra-deployments/pull/new/preview-main-jnav remote: To https://github.com/redhat-appstudio-qe/infra-deployments.git * [new branch] preview-main-jnav -> preview-main-jnav branch 'preview-main-jnav' set up to track 'qe/preview-main-jnav'. application.argoproj.io/all-application-sets created Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app Waiting for sync of all-application-sets argoCD app application.argoproj.io/squid-in-cluster-local patched application.argoproj.io/build-templates-in-cluster-local patched application.argoproj.io/pipeline-service-in-cluster-local patched application.argoproj.io/image-controller-in-cluster-local patched application.argoproj.io/tracing-workload-tracing-in-cluster-local patched application.argoproj.io/build-service-in-cluster-local patched application.argoproj.io/disable-csvcopy-in-cluster-local patched application.argoproj.io/project-controller-in-cluster-local patched application.argoproj.io/vector-kubearchive-log-collector-in-cluster-local patched (no change) application.argoproj.io/perf-team-prometheus-reader-in-cluster-local patched application.argoproj.io/internal-services-in-cluster-local patched application.argoproj.io/kyverno-in-cluster-local patched application.argoproj.io/konflux-kite-in-cluster-local patched application.argoproj.io/crossplane-control-plane-in-cluster-local patched application.argoproj.io/integration-in-cluster-local patched application.argoproj.io/kueue-in-cluster-local patched application.argoproj.io/mintmaker-in-cluster-local patched application.argoproj.io/monitoring-workload-prometheus-in-cluster-local patched application.argoproj.io/all-application-sets patched application.argoproj.io/enterprise-contract-in-cluster-local patched application.argoproj.io/has-in-cluster-local patched application.argoproj.io/trust-manager-in-cluster-local patched application.argoproj.io/dora-metrics-in-cluster-local patched application.argoproj.io/cert-manager-in-cluster-local patched application.argoproj.io/release-in-cluster-local patched application.argoproj.io/monitoring-workload-grafana-in-cluster-local patched application.argoproj.io/application-api-in-cluster-local patched application.argoproj.io/ingresscontroller-in-cluster-local patched application.argoproj.io/policies-in-cluster-local patched application.argoproj.io/repository-validator-in-cluster-local patched application.argoproj.io/multi-platform-controller-in-cluster-local patched application.argoproj.io/vector-tekton-logs-collector-in-cluster-local patched application.argoproj.io/tracing-workload-otel-collector-in-cluster-local patched application.argoproj.io/knative-eventing-in-cluster-local patched application.argoproj.io/konflux-rbac-in-cluster-local patched application.argoproj.io/tempo-in-cluster-local patched application.argoproj.io/kubearchive-in-cluster-local patched application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy dora-metrics-in-cluster-local Synced Progressing enterprise-contract-in-cluster-local OutOfSync Missing integration-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Degraded kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy postgres Synced Progressing release-in-cluster-local OutOfSync Missing squid-in-cluster-local OutOfSync Missing tracing-workload-otel-collector-in-cluster-local OutOfSync Missing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing vector-tekton-logs-collector-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing integration-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Degraded kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Degraded policies-in-cluster-local OutOfSync Healthy postgres Synced Progressing release-in-cluster-local OutOfSync Missing squid-in-cluster-local OutOfSync Missing tracing-workload-otel-collector-in-cluster-local OutOfSync Missing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Degraded kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy postgres Synced Progressing release-in-cluster-local OutOfSync Missing squid-in-cluster-local OutOfSync Missing trust-manager-in-cluster-local OutOfSync Degraded vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Degraded kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local OutOfSync Missing squid-in-cluster-local OutOfSync Missing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Degraded kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local OutOfSync Missing squid-in-cluster-local OutOfSync Missing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Degraded kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local OutOfSync Missing squid-in-cluster-local OutOfSync Missing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Degraded kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local OutOfSync Missing squid-in-cluster-local OutOfSync Missing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Missing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local OutOfSync Missing squid-in-cluster-local OutOfSync Missing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Missing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local Synced Progressing squid-in-cluster-local OutOfSync Degraded tracing-workload-tracing-in-cluster-local OutOfSync Healthy trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Missing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local Synced Progressing squid-in-cluster-local OutOfSync Degraded tracing-workload-tracing-in-cluster-local OutOfSync Healthy trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing integration-in-cluster-local Synced Progressing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Missing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local Synced Progressing squid-in-cluster-local OutOfSync Missing tracing-workload-tracing-in-cluster-local OutOfSync Healthy trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync application-api-in-cluster-local OutOfSync Missing build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing integration-in-cluster-local Synced Progressing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kubearchive-in-cluster-local Synced Progressing kueue-in-cluster-local OutOfSync Missing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local Synced Progressing squid-in-cluster-local OutOfSync Missing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing konflux-rbac-in-cluster-local OutOfSync Healthy kueue-in-cluster-local OutOfSync Missing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Progressing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local Synced Progressing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing kueue-in-cluster-local OutOfSync Missing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Missing multi-platform-controller-in-cluster-local OutOfSync Progressing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local Synced Progressing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing kueue-in-cluster-local OutOfSync Missing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Healthy multi-platform-controller-in-cluster-local OutOfSync Healthy pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local Synced Progressing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync build-service-in-cluster-local Synced Progressing crossplane-control-plane-in-cluster-local OutOfSync Healthy enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing kueue-in-cluster-local OutOfSync Missing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Healthy multi-platform-controller-in-cluster-local OutOfSync Healthy pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy release-in-cluster-local Synced Progressing trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing knative-eventing-in-cluster-local OutOfSync Missing kueue-in-cluster-local OutOfSync Progressing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Healthy multi-platform-controller-in-cluster-local OutOfSync Healthy pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Missing Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing kueue-in-cluster-local OutOfSync Progressing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Healthy multi-platform-controller-in-cluster-local OutOfSync Healthy pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local OutOfSync Progressing Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing kueue-in-cluster-local OutOfSync Healthy kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Healthy multi-platform-controller-in-cluster-local OutOfSync Healthy pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local Unknown Progressing Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing kueue-in-cluster-local OutOfSync Healthy kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Healthy multi-platform-controller-in-cluster-local OutOfSync Healthy pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local Unknown Progressing Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing kueue-in-cluster-local OutOfSync Healthy kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Healthy multi-platform-controller-in-cluster-local OutOfSync Healthy pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy trust-manager-in-cluster-local OutOfSync Missing vector-kubearchive-log-collector-in-cluster-local Unknown Progressing Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing kyverno-in-cluster-local OutOfSync Missing monitoring-workload-grafana-in-cluster-local OutOfSync Healthy pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy vector-kubearchive-log-collector-in-cluster-local Synced Progressing Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync enterprise-contract-in-cluster-local OutOfSync Missing internal-services-in-cluster-local OutOfSync Missing pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync pipeline-service-in-cluster-local OutOfSync Missing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync pipeline-service-in-cluster-local Synced Progressing policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync monitoring-workload-prometheus-in-cluster-local OutOfSync Healthy policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync policies-in-cluster-local OutOfSync Healthy Waiting 10 seconds for application sync All Applications are synced and Healthy All required tekton resources are installed and ready Tekton CRDs are ready Setup Pac with existing QE sprayproxy and github App namespace/openshift-pipelines configured namespace/build-service configured namespace/integration-service configured secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created secret/pipelines-as-code-secret created Configured pipelines-as-code-secret secret in openshift-pipelines namespace Switched to branch 'main' Your branch is up to date with 'upstream/main'. [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 92 [running]: > runtime/debug.Stack() > /usr/lib/golang/src/runtime/debug/stack.go:26 +0x5e > sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot() > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/log/log.go:60 +0xcd > sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0xc000a26a40, {0x2f94060, 0x14}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/log/deleg.go:147 +0x3e > github.com/go-logr/logr.Logger.WithName({{0x36edaf0, 0xc000a26a40}, 0x0}, {0x2f94060?, 0x0?}) > /opt/app-root/src/go/pkg/mod/github.com/go-logr/logr@v1.4.2/logr.go:345 +0x36 > sigs.k8s.io/controller-runtime/pkg/client.newClient(0x2d71be0?, {0x0, 0xc0004dd5e0, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/client/client.go:129 +0xf1 > sigs.k8s.io/controller-runtime/pkg/client.New(0xc00012b448?, {0x0, 0xc0004dd5e0, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0}) > /opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.6/pkg/client/client.go:110 +0x7d > github.com/konflux-ci/e2e-tests/pkg/clients/kubernetes.NewAdminKubernetesClient() > /tmp/tmp.kq9YdfGzvp/pkg/clients/kubernetes/client.go:157 +0xa5 > github.com/konflux-ci/e2e-tests/pkg/clients/sprayproxy.GetPaCHost() > /tmp/tmp.kq9YdfGzvp/pkg/clients/sprayproxy/sprayproxy.go:93 +0x1c > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.registerPacServer() > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/repos/common.go:426 +0x78 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine/repos.init.func8(0xc000eac908?) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/repos/common.go:378 +0x25 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.ActionFunc.Execute(0xc?, 0x2f6ead5?) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/types.go:279 +0x19 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Apply(...) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/types.go:315 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x5246200, 0xc000eac908) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/types.go:348 +0xb3 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x523ec80?, 0xc001183c00?, 0x1f1bc99?}, 0xc000eac908) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Check(0x52462c0, 0xc000eac908) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/types.go:340 +0x2b > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.All.Check({0x5247f40?, 0x7fd05e3c44f0?, 0x70?}, 0xc000eac908) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/types.go:245 +0x4f > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*Rule).Eval(...) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/types.go:308 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).runLoadedCatalog(0x527d970, {0xc000aa2a08?, 0xc000e4de60?, 0x47?}, 0xc000eac908) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/types.go:129 +0x119 > github.com/konflux-ci/e2e-tests/magefiles/rulesengine.(*RuleEngine).RunRulesOfCategory(0x527d970, {0x2f68e83, 0x2}, 0xc000eac908) > /tmp/tmp.kq9YdfGzvp/magefiles/rulesengine/types.go:121 +0x1b4 > main.CI.TestE2E({}) > /tmp/tmp.kq9YdfGzvp/magefiles/magefile.go:322 +0x18a > main.main.func19({0x0?, 0x0?}) > /tmp/tmp.kq9YdfGzvp/magefiles/mage_output_file.go:827 +0xf > main.main.func12.1() > /tmp/tmp.kq9YdfGzvp/magefiles/mage_output_file.go:302 +0x5b > created by main.main.func12 in goroutine 1 > /tmp/tmp.kq9YdfGzvp/magefiles/mage_output_file.go:297 +0xbe I1022 11:32:47.724585 16387 common.go:434] Registered PaC server: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-2d7e05980f.tn5s.p3.openshiftapps.com I1022 11:32:47.790805 16387 common.go:459] The PaC servers registered in Sprayproxy: https://pipelines-as-code-controller-openshift-pipelines.apps.rosa.kx-2d7e05980f.tn5s.p3.openshiftapps.com I1022 11:32:47.790835 16387 common.go:475] going to create new Tekton bundle remote-build for the purpose of testing multi-platform-controller PR I1022 11:32:48.226954 16387 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.6@sha256:e8648dff9859d89a0dbaedd120eec2e07afbffc850e706d16d0ac479a905efa0 I1022 11:32:48.229665 16387 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761132767-iktk -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I1022 11:32:49.686138 16387 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761132767-iktk: quay.io/redhat-appstudio-qe/test-images@sha256:3b7d73109656695d4b1f43785143473dbb58ab975b58eac6f8f273daa6b6a157 I1022 11:32:49.686168 16387 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_ARM64 to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761132767-iktk I1022 11:32:50.128666 16387 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.6@sha256:e8648dff9859d89a0dbaedd120eec2e07afbffc850e706d16d0ac479a905efa0 I1022 11:32:50.130697 16387 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761132769-qknh -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I1022 11:32:52.572285 16387 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761132769-qknh: quay.io/redhat-appstudio-qe/test-images@sha256:e2ab046bf9661874b679e1c9d7020091e7c6bb2aaf7343309a5ee356cdb301f8 I1022 11:32:52.572319 16387 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_S390X to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761132769-qknh I1022 11:32:52.903372 16387 common.go:516] Found current task ref quay.io/konflux-ci/tekton-catalog/task-buildah:0.6@sha256:e8648dff9859d89a0dbaedd120eec2e07afbffc850e706d16d0ac479a905efa0 I1022 11:32:52.905421 16387 util.go:521] found credentials for image ref quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761132772-qpnw -> user: redhat-appstudio-qe+redhat_appstudio_quality Creating Tekton Bundle: - Added Pipeline: buildah-remote-pipeline to image I1022 11:32:54.750787 16387 bundle.go:57] image digest for a new tekton bundle quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761132772-qpnw: quay.io/redhat-appstudio-qe/test-images@sha256:33434faf35c17d167ed4ab5c66bf662b6ea10eda9348d97ddf4a2a4204c35bbf I1022 11:32:54.750824 16387 common.go:542] SETTING ENV VAR CUSTOM_BUILDAH_REMOTE_PIPELINE_BUILD_BUNDLE_PPC64LE to value quay.io/redhat-appstudio-qe/test-images:pipeline-bundle-1761132772-qpnw exec: ginkgo "--seed=1761131409" "--timeout=1h30m0s" "--grace-period=30s" "--output-interceptor-mode=none" "--label-filter=!upgrade-create && !upgrade-verify && !upgrade-cleanup && !release-pipelines" "--no-color" "--json-report=e2e-report.json" "--junit-report=e2e-report.xml" "--procs=20" "--nodes=20" "--p" "--output-dir=/workspace/artifact-dir" "./cmd" "--" go: downloading github.com/konflux-ci/build-service v0.0.0-20240611083846-2dee6cfe6fe4 go: downloading github.com/IBM/go-sdk-core/v5 v5.15.3 go: downloading github.com/aws/aws-sdk-go-v2 v1.32.7 go: downloading github.com/aws/aws-sdk-go-v2/config v1.28.7 go: downloading github.com/IBM/vpc-go-sdk v0.48.0 go: downloading github.com/aws/aws-sdk-go-v2/service/ec2 v1.135.0 go: downloading github.com/go-openapi/strfmt v0.22.0 go: downloading github.com/go-playground/validator/v10 v10.17.0 go: downloading github.com/leodido/go-urn v1.3.0 go: downloading github.com/gabriel-vasile/mimetype v1.4.3 go: downloading github.com/go-playground/universal-translator v0.18.1 go: downloading github.com/go-playground/locales v0.14.1 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/go-openapi/errors v0.21.0 go: downloading github.com/asaskevich/govalidator v0.0.0-20230301143203-a9d515a09cc2 go: downloading go.mongodb.org/mongo-driver v1.13.1 go: downloading github.com/aws/smithy-go v1.22.1 go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.17.48 go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.22 go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.24.8 go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.8.1 go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.28.7 go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.33.3 go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.26 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.1 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.7 go: downloading github.com/google/go-github/v45 v45.2.0 go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.26 Running Suite: Red Hat App Studio E2E tests - /tmp/tmp.kq9YdfGzvp/cmd ===================================================================== Random Seed: 1761131409 Will run 311 of 389 specs Running in parallel across 20 processes SSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context points to a file [build-templates] /tmp/tmp.kq9YdfGzvp/tests/build/tkn-bundle.go:177 ------------------------------ SSS ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles from specific context [build-templates] /tmp/tmp.kq9YdfGzvp/tests/build/tkn-bundle.go:188 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params when context is the root directory [build-templates] /tmp/tmp.kq9YdfGzvp/tests/build/tkn-bundle.go:198 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when context points to a file and a directory [build-templates] /tmp/tmp.kq9YdfGzvp/tests/build/tkn-bundle.go:207 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params creates Tekton bundles when using negation [build-templates] /tmp/tmp.kq9YdfGzvp/tests/build/tkn-bundle.go:217 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding HOME environment variable [build-templates] /tmp/tmp.kq9YdfGzvp/tests/build/tkn-bundle.go:227 ------------------------------ P [PENDING] [task-suite tkn bundle task] creates Tekton bundles with different params allows overriding STEP image [build-templates] /tmp/tmp.kq9YdfGzvp/tests/build/tkn-bundle.go:236 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if release CR is created [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.kq9YdfGzvp/tests/release/pipelines/release_to_github.go:139 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies the release pipelinerun is running and succeeds [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.kq9YdfGzvp/tests/release/pipelines/release_to_github.go:149 ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies release CR completed and set succeeded. [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.kq9YdfGzvp/tests/release/pipelines/release_to_github.go:182 ------------------------------ S ------------------------------ P [PENDING] [release-pipelines-suite e2e tests for release-to-github pipeline] Release-to-github happy path Post-release verification verifies if the Release exists in github repo [release-pipelines, release-to-github, releaseToGithub] /tmp/tmp.kq9YdfGzvp/tests/release/pipelines/release_to_github.go:193 ------------------------------ SSSSSSSSSSSSSSSS ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-host-pool] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:120 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-host-pool] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:124 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-host-pool] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:127 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-host-pool] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:148 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws host-pool allocation when the Component with multi-platform-build is created test that cleanup happened successfully [multi-platform, aws-host-pool] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:152 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, aws-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:251 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, aws-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:255 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, aws-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:259 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, aws-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:263 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] aws dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, aws-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:267 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmz-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:341 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmz-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:345 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmz-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:349 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmz-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:353 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm system z dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmz-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:357 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created a PipelineRun is triggered [multi-platform, ibmp-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:432 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created the build-container task from component pipelinerun is buildah-remote [multi-platform, ibmp-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:436 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created The multi platform secret is populated [multi-platform, ibmp-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:440 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created that PipelineRun completes successfully [multi-platform, ibmp-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:444 ------------------------------ P [PENDING] [multi-platform-build-service-suite Multi Platform Controller E2E tests] ibm power pc dynamic allocation when the Component with multi-platform-build is created check cleanup happened successfully [multi-platform, ibmp-dynamic] /tmp/tmp.kq9YdfGzvp/tests/build/multi-platform.go:448 ------------------------------ •••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• ------------------------------ P [PENDING] [build-service-suite Build service E2E tests] test build secret lookup when two secrets are created when second component is deleted, pac pr branch should not exist in the repo [build-service, pac-build, secret-lookup] /tmp/tmp.kq9YdfGzvp/tests/build/build.go:1118 ------------------------------ ••••••••••S•S•• ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.kq9YdfGzvp/tests/build/build_templates.go:489 ------------------------------ ••••••••••S••••••••••••••••••••••••••••• ------------------------------ • [FAILED] [33.103 seconds] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci build-definitions ec pipelines [It] runs ec pipeline pipelines/enterprise-contract.yaml [build, build-templates, HACBS, pipeline-service, pipeline, build-templates-e2e] /tmp/tmp.kq9YdfGzvp/tests/build/build_templates.go:698 Timeline >> PipelineRun test-comp-mdye-on-pull-request-k9vkk reason: Completed Creating Pipeline "ec-integration-test-scenario-run-tj299" Waiting for pipeline "ec-integration-test-scenario-run-tj299" to finish The PipelineRun ec-integration-test-scenario-run-tj299 in namespace build-e2e-fqfm has status.conditions: v1.Conditions{apis.Condition{Type:"Succeeded", Status:"True", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:time.Date(2025, time.October, 22, 11, 43, 42, 0, time.Local)}, Reason:"Succeeded", Message:"Tasks Completed: 1 (Failed: 0, Cancelled 0), Skipped: 0"}} [FAILED] in [It] - /tmp/tmp.kq9YdfGzvp/tests/build/build_templates.go:744 @ 10/22/25 11:43:42.273 << Timeline [FAILED] Expected : to equal : enterprise-contract In [It] at: /tmp/tmp.kq9YdfGzvp/tests/build/build_templates.go:744 @ 10/22/25 11:43:42.273 ------------------------------ SSSSSS ------------------------------ P [PENDING] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci when Pipeline Results are stored for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic and Pipeline docker-build-oci-ta should have Pipeline Logs [build, build-templates, HACBS, pipeline-service, pipeline] /tmp/tmp.kq9YdfGzvp/tests/build/build_templates.go:489 ------------------------------ SSSSS•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• Summarizing 1 Failure: [FAIL] [build-service-suite Build templates E2E test] HACBS pipelines scenario sample-python-basic-oci build-definitions ec pipelines [It] runs ec pipeline pipelines/enterprise-contract.yaml [build, build-templates, HACBS, pipeline-service, pipeline, build-templates-e2e] /tmp/tmp.kq9YdfGzvp/tests/build/build_templates.go:744 Ran 297 of 389 Specs in 2032.214 seconds FAIL! -- 296 Passed | 1 Failed | 34 Pending | 58 Skipped Ginkgo ran 1 suite in 35m24.364180413s Test Suite Failed Error: running "ginkgo --seed=1761131409 --timeout=1h30m0s --grace-period=30s --output-interceptor-mode=none --label-filter=!upgrade-create && !upgrade-verify && !upgrade-cleanup && !release-pipelines --no-color --json-report=e2e-report.json --junit-report=e2e-report.xml --procs=20 --nodes=20 --p --output-dir=/workspace/artifact-dir ./cmd --" failed with exit code 1 make: *** [Makefile:25: ci/test/e2e] Error 1