INFO: Log in to your Red Hat account... INFO: Configure AWS Credentials... WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. INFO: Logged in as 'konflux-ci-418295695583' on 'https://api.openshift.com' INFO: Create ROSA with HCP cluster... WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. INFO: Creating cluster 'kx-66b6cd1360' INFO: To view a list of clusters and their status, run 'rosa list clusters' INFO: Cluster 'kx-66b6cd1360' has been created. INFO: Once the cluster is installed you will need to add an Identity Provider before you can login into the cluster. See 'rosa create idp --help' for more information. Name: kx-66b6cd1360 Domain Prefix: kx-66b6cd1360 Display Name: kx-66b6cd1360 ID: 2ppp9o7864pnla9cqunrn7gokag4ggfc External ID: e074d0ff-1efa-4688-9f61-037fd0eb4d95 Control Plane: ROSA Service Hosted OpenShift Version: 4.18.9 Channel Group: stable DNS: Not ready AWS Account: 418295695583 AWS Billing Account: 418295695583 API URL: Console URL: Region: us-east-1 Availability: - Control Plane: MultiAZ - Data Plane: MultiAZ Nodes: - Compute (desired): 3 - Compute (current): 0 Network: - Type: OVNKubernetes - Service CIDR: 172.30.0.0/16 - Machine CIDR: 10.0.0.0/16 - Pod CIDR: 10.128.0.0/14 - Host Prefix: /23 - Subnets: subnet-001fc23497e4a3aeb, subnet-00ffba09365a434bc, subnet-074cbf0329958194a, subnet-0689cd077699b690a, subnet-0f9f09e46f74cde64, subnet-033f48892ddbaa09d EC2 Metadata Http Tokens: optional Role (STS) ARN: arn:aws:iam::418295695583:role/ManagedOpenShift-HCP-ROSA-Installer-Role Support Role ARN: arn:aws:iam::418295695583:role/ManagedOpenShift-HCP-ROSA-Support-Role Instance IAM Roles: - Worker: arn:aws:iam::418295695583:role/ManagedOpenShift-HCP-ROSA-Worker-Role Operator IAM Roles: - arn:aws:iam::418295695583:role/rosa-hcp-openshift-cluster-csi-drivers-ebs-cloud-credentials - arn:aws:iam::418295695583:role/rosa-hcp-kube-system-control-plane-operator - arn:aws:iam::418295695583:role/rosa-hcp-kube-system-kms-provider - arn:aws:iam::418295695583:role/rosa-hcp-kube-system-kube-controller-manager - arn:aws:iam::418295695583:role/rosa-hcp-kube-system-capa-controller-manager - arn:aws:iam::418295695583:role/rosa-hcp-openshift-cloud-network-config-controller-cloud-credent - arn:aws:iam::418295695583:role/rosa-hcp-openshift-image-registry-installer-cloud-credentials - arn:aws:iam::418295695583:role/rosa-hcp-openshift-ingress-operator-cloud-credentials Managed Policies: Yes State: waiting (Waiting for user action) Private: No Delete Protection: Disabled Created: Apr 20 2026 08:25:09 UTC Details Page: https://console.redhat.com/openshift/details/s/3Cc8U3ZIJ8VHTJFk3XSZWGpCKcK OIDC Endpoint URL: https://oidc.op1.openshiftapps.com/2du11g36ejmoo4624pofphlrgf4r9tf3 (Managed) Etcd Encryption: Disabled Audit Log Forwarding: Disabled External Authentication: Disabled INFO: Preparing to create operator roles. INFO: Operator Roles already exists INFO: Preparing to create OIDC Provider. INFO: OIDC provider already exists INFO: To determine when your cluster is Ready, run 'rosa describe cluster -c kx-66b6cd1360'. INFO: To watch your cluster installation logs, run 'rosa logs install -c kx-66b6cd1360 --watch'. INFO: Track the progress of the cluster creation... WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. W: Region flag will be removed from this command in future versions INFO: Cluster 'kx-66b6cd1360' is in waiting state waiting for installation to begin. Logs will show up within 5 minutes 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-66b6cd1360 Version 2026-04-20 08:28:31 +0000 UTC hostedclusters kx-66b6cd1360 ValidAWSIdentityProvider StatusUnknown 2026-04-20 08:28:32 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2026-04-20 08:28:32 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Ignition server deployment not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 HostedCluster is supported by operator configuration 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Release image is valid 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Reconciliation active on resource 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Ignition server deployment not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 HostedCluster is supported by operator configuration 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Release image is valid 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Reconciliation active on resource 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Ignition server deployment not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 HostedCluster is supported by operator configuration 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Release image is valid 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Reconciliation active on resource 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Ignition server deployment not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 HostedCluster is supported by operator configuration 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Release image is valid 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Reconciliation active on resource 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Ignition server deployment not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 HostedCluster is supported by operator configuration 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Release image is valid 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Reconciliation active on resource 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Ignition server deployment not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 HostedCluster is supported by operator configuration 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Release image is valid 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Reconciliation active on resource 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-66b6cd1360 Version 2026-04-20 08:28:31 +0000 UTC hostedclusters kx-66b6cd1360 ValidAWSIdentityProvider StatusUnknown 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Release image is valid 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the HCP 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 HostedCluster is at expected version 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Reconciliation active on resource 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Ignition server deployment not found 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 HostedCluster is supported by operator configuration 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 router load balancer is not provisioned; 7s since creation.; router load balancer is not provisioned; 7s since creation. 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:29:59 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2026-04-20 08:30:03 +0000 UTC hostedclusters kx-66b6cd1360 Configuration passes validation 2026-04-20 08:30:04 +0000 UTC hostedclusters kx-66b6cd1360 Required platform credentials are found 2026-04-20 08:30:06 +0000 UTC hostedclusters kx-66b6cd1360 OIDC configuration is valid 2026-04-20 08:30:06 +0000 UTC hostedclusters kx-66b6cd1360 Reconciliation completed successfully 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 router load balancer is not provisioned; 7s since creation.; router load balancer is not provisioned; 7s since creation. 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 lookup api.kx-66b6cd1360.yjai.p3.openshiftapps.com on 172.30.0.10:53: no such host 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 Configuration passes validation 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 capi-provider deployment has 1 unavailable replicas 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 AWS KMS is not configured 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 EtcdAvailable StatefulSetNotFound 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 Kube APIServer deployment not found 2026-04-20 08:30:28 +0000 UTC hostedclusters kx-66b6cd1360 All is well 2026-04-20 08:30:29 +0000 UTC hostedclusters kx-66b6cd1360 All is well 2026-04-20 08:30:36 +0000 UTC hostedclusters kx-66b6cd1360 WebIdentityErr 2026-04-20 08:30:55 +0000 UTC hostedclusters kx-66b6cd1360 EtcdAvailable QuorumAvailable 2026-04-20 08:31:24 +0000 UTC hostedclusters kx-66b6cd1360 Kube APIServer deployment is available 2026-04-20 08:31:36 +0000 UTC hostedclusters kx-66b6cd1360 All is well 2026-04-20 08:31:51 +0000 UTC hostedclusters kx-66b6cd1360 All is well 2026-04-20 08:31:55 +0000 UTC hostedclusters kx-66b6cd1360 Ignition server deployment is available 2026-04-20 08:32:09 +0000 UTC hostedclusters kx-66b6cd1360 ClusterVersionAvailable FromClusterVersion 2026-04-20 08:32:09 +0000 UTC hostedclusters kx-66b6cd1360 ClusterVersionSucceeding FromClusterVersion 2026-04-20 08:32:09 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:32:09 +0000 UTC hostedclusters kx-66b6cd1360 Working towards 4.18.9: 470 of 613 done (76% complete) 2026-04-20 08:32:09 +0000 UTC hostedclusters kx-66b6cd1360 Payload loaded version="4.18.9" image="quay.io/openshift-release-dev/ocp-release@sha256:dafd6d1fe6008bf1a3e5baea3420aa0344412bf3167e1e92bec5c92098dc6464" architecture="Multi" 2026-04-20 08:32:39 +0000 UTC hostedclusters kx-66b6cd1360 Multiple errors are preventing progress: * Cluster operators console, dns, ingress, insights, kube-storage-version-migrator, monitoring, network, node-tuning, openshift-samples, service-ca, storage are not available * Could not update imagestream "openshift/driver-toolkit" (440 of 613): resource may have been deleted * Could not update operatorgroup "openshift-monitoring/openshift-cluster-monitoring" (554 of 613): resource may have been deleted * Could not update role "openshift-authentication/prometheus-k8s" (541 of 613): resource may have been deleted * Could not update role "openshift-console-operator/prometheus-k8s" (571 of 613): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (575 of 613): resource may have been deleted * Could not update role "openshift-ingress-operator/prometheus-k8s" (582 of 613): resource may have been deleted * Could not update role "openshift-kube-apiserver-operator/prometheus-k8s" (586 of 613): resource may have been deleted 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-66b6cd1360 Version 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 HostedCluster is at expected version 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Reconciliation active on resource 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 Release image is valid 2026-04-20 08:28:34 +0000 UTC hostedclusters kx-66b6cd1360 HostedCluster is supported by operator configuration 2026-04-20 08:29:59 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2026-04-20 08:30:03 +0000 UTC hostedclusters kx-66b6cd1360 Configuration passes validation 2026-04-20 08:30:04 +0000 UTC hostedclusters kx-66b6cd1360 Required platform credentials are found 2026-04-20 08:30:06 +0000 UTC hostedclusters kx-66b6cd1360 Reconciliation completed successfully 2026-04-20 08:30:06 +0000 UTC hostedclusters kx-66b6cd1360 OIDC configuration is valid 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 Configuration passes validation 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 lookup api.kx-66b6cd1360.yjai.p3.openshiftapps.com on 172.30.0.10:53: no such host 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 kube-controller-manager deployment has 1 unavailable replicas 2026-04-20 08:30:07 +0000 UTC hostedclusters kx-66b6cd1360 AWS KMS is not configured 2026-04-20 08:30:28 +0000 UTC hostedclusters kx-66b6cd1360 All is well 2026-04-20 08:30:29 +0000 UTC hostedclusters kx-66b6cd1360 All is well 2026-04-20 08:30:55 +0000 UTC hostedclusters kx-66b6cd1360 EtcdAvailable QuorumAvailable 2026-04-20 08:31:24 +0000 UTC hostedclusters kx-66b6cd1360 Kube APIServer deployment is available 2026-04-20 08:31:36 +0000 UTC hostedclusters kx-66b6cd1360 All is well 2026-04-20 08:31:51 +0000 UTC hostedclusters kx-66b6cd1360 All is well 2026-04-20 08:31:55 +0000 UTC hostedclusters kx-66b6cd1360 Ignition server deployment is available 2026-04-20 08:32:09 +0000 UTC hostedclusters kx-66b6cd1360 Unable to apply 4.18.9: some cluster operators are not available 2026-04-20 08:32:09 +0000 UTC hostedclusters kx-66b6cd1360 Condition not found in the CVO. 2026-04-20 08:32:09 +0000 UTC hostedclusters kx-66b6cd1360 Payload loaded version="4.18.9" image="quay.io/openshift-release-dev/ocp-release@sha256:dafd6d1fe6008bf1a3e5baea3420aa0344412bf3167e1e92bec5c92098dc6464" architecture="Multi" 2026-04-20 08:32:09 +0000 UTC hostedclusters kx-66b6cd1360 ClusterVersionAvailable FromClusterVersion 2026-04-20 08:32:52 +0000 UTC hostedclusters kx-66b6cd1360 Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available 2026-04-20 08:33:07 +0000 UTC hostedclusters kx-66b6cd1360 The hosted control plane is available INFO: Cluster 'kx-66b6cd1360' is now ready INFO: ROSA with HCP cluster is ready, create a cluster admin account for accessing the cluster WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. INFO: Storing login command... INFO: Check if it's able to login to OCP cluster... Retried 1 times... INFO: Check if apiserver is ready... Waiting for cluster operators to be accessible for 2m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 4m5s dns 4.18.9 False False True 4m5s DNS "default" is unavailable. image-registry False True True 3m50s Available: The deployment does not have available replicas... ingress False True True 3m49s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 3m55s kube-controller-manager 4.18.9 True False False 3m55s kube-scheduler 4.18.9 True False False 3m55s kube-storage-version-migrator monitoring network 4.18.9 True True False 3m37s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 3m36s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 3m55s openshift-controller-manager 4.18.9 True False False 3m55s openshift-samples operator-lifecycle-manager 4.18.9 True False False 3m57s operator-lifecycle-manager-catalog 4.18.9 True False False 3m50s operator-lifecycle-manager-packageserver 4.18.9 True False False 3m55s service-ca storage 4.18.9 False False False 3m54s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service cluster operators to be accessible finished! [INFO] Cluster operators are accessible. Waiting for cluster to be reported as healthy for 60m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 4m5s dns 4.18.9 False False True 4m5s DNS "default" is unavailable. image-registry False True True 3m50s Available: The deployment does not have available replicas... ingress False True True 3m49s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 3m55s kube-controller-manager 4.18.9 True False False 3m55s kube-scheduler 4.18.9 True False False 3m55s kube-storage-version-migrator monitoring network 4.18.9 True True False 3m37s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 3m36s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 3m55s openshift-controller-manager 4.18.9 True False False 3m55s openshift-samples operator-lifecycle-manager 4.18.9 True False False 3m57s operator-lifecycle-manager-catalog 4.18.9 True False False 3m50s operator-lifecycle-manager-packageserver 4.18.9 True False False 3m55s service-ca storage 4.18.9 False False False 3m54s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 5m6s dns 4.18.9 False False True 5m6s DNS "default" is unavailable. image-registry False True True 4m51s Available: The deployment does not have available replicas... ingress False True True 4m50s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 4m56s kube-controller-manager 4.18.9 True False False 4m56s kube-scheduler 4.18.9 True False False 4m56s kube-storage-version-migrator monitoring network 4.18.9 True True False 4m38s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 4m37s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 4m56s openshift-controller-manager 4.18.9 True False False 4m56s openshift-samples operator-lifecycle-manager 4.18.9 True False False 4m58s operator-lifecycle-manager-catalog 4.18.9 True False False 4m51s operator-lifecycle-manager-packageserver 4.18.9 True False False 4m56s service-ca storage 4.18.9 False False False 4m55s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 6m7s dns 4.18.9 False False True 6m7s DNS "default" is unavailable. image-registry False True True 5m52s Available: The deployment does not have available replicas... ingress False True True 5m51s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 5m57s kube-controller-manager 4.18.9 True False False 5m57s kube-scheduler 4.18.9 True False False 5m57s kube-storage-version-migrator monitoring network 4.18.9 True True False 5m39s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 5m38s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 5m57s openshift-controller-manager 4.18.9 True False False 5m57s openshift-samples operator-lifecycle-manager 4.18.9 True False False 5m59s operator-lifecycle-manager-catalog 4.18.9 True False False 5m52s operator-lifecycle-manager-packageserver 4.18.9 True False False 5m57s service-ca storage 4.18.9 False False False 5m56s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 7m7s dns 4.18.9 False False True 7m7s DNS "default" is unavailable. image-registry False True True 6m52s Available: The deployment does not have available replicas... ingress False True True 6m51s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 6m57s kube-controller-manager 4.18.9 True False False 6m57s kube-scheduler 4.18.9 True False False 6m57s kube-storage-version-migrator monitoring network 4.18.9 True True False 6m39s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 6m38s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 6m57s openshift-controller-manager 4.18.9 True False False 6m57s openshift-samples operator-lifecycle-manager 4.18.9 True False False 6m59s operator-lifecycle-manager-catalog 4.18.9 True False False 6m52s operator-lifecycle-manager-packageserver 4.18.9 True False False 6m57s service-ca storage 4.18.9 False False False 6m56s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 8m7s dns 4.18.9 False False True 8m7s DNS "default" is unavailable. image-registry False True True 7m52s Available: The deployment does not have available replicas... ingress False True True 7m51s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 7m57s kube-controller-manager 4.18.9 True False False 7m57s kube-scheduler 4.18.9 True False False 7m57s kube-storage-version-migrator monitoring network 4.18.9 True True False 7m39s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 7m38s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 7m57s openshift-controller-manager 4.18.9 True False False 7m57s openshift-samples operator-lifecycle-manager 4.18.9 True False False 7m59s operator-lifecycle-manager-catalog 4.18.9 True False False 7m52s operator-lifecycle-manager-packageserver 4.18.9 True False False 7m57s service-ca storage 4.18.9 False False False 7m56s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 9m7s dns 4.18.9 False False True 9m7s DNS "default" is unavailable. image-registry False True True 8m52s Available: The deployment does not have available replicas... ingress False True True 8m51s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 8m57s kube-controller-manager 4.18.9 True False False 8m57s kube-scheduler 4.18.9 True False False 8m57s kube-storage-version-migrator monitoring network 4.18.9 True True False 8m39s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 8m38s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 8m57s openshift-controller-manager 4.18.9 True False False 8m57s openshift-samples operator-lifecycle-manager 4.18.9 True False False 8m59s operator-lifecycle-manager-catalog 4.18.9 True False False 8m52s operator-lifecycle-manager-packageserver 4.18.9 True False False 8m57s service-ca storage 4.18.9 False False False 8m56s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 10m dns 4.18.9 False False True 10m DNS "default" is unavailable. image-registry False True True 9m53s Available: The deployment does not have available replicas... ingress False True True 9m52s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 9m58s kube-controller-manager 4.18.9 True False False 9m58s kube-scheduler 4.18.9 True False False 9m58s kube-storage-version-migrator monitoring network 4.18.9 True True False 9m40s DaemonSet "/openshift-multus/multus-additional-cni-plugins" is not available (awaiting 3 nodes)... node-tuning 4.18.9 True True False 19s Waiting for 3/3 Profiles to be applied openshift-apiserver 4.18.9 True False False 9m58s openshift-controller-manager 4.18.9 True False False 9m58s openshift-samples operator-lifecycle-manager 4.18.9 True False False 10m operator-lifecycle-manager-catalog 4.18.9 True False False 9m53s operator-lifecycle-manager-packageserver 4.18.9 True False False 9m58s service-ca storage 4.18.9 True False False 19s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 2s csi-snapshot-controller 4.18.9 True False False 11m dns 4.18.9 True True True 5s DNS default is degraded image-registry False True True 10m Available: The deployment does not have available replicas... ingress False True True 10m The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights 4.18.9 True False False 50s kube-apiserver 4.18.9 True False False 10m kube-controller-manager 4.18.9 True False False 10m kube-scheduler 4.18.9 True False False 10m kube-storage-version-migrator 4.18.9 True False False 44s monitoring Unknown True Unknown 23s Rolling out the stack. network 4.18.9 True False False 10m node-tuning 4.18.9 True False False 79s openshift-apiserver 4.18.9 True False False 10m openshift-controller-manager 4.18.9 True False False 10m openshift-samples operator-lifecycle-manager 4.18.9 True False False 11m operator-lifecycle-manager-catalog 4.18.9 True False False 10m operator-lifecycle-manager-packageserver 4.18.9 True False False 10m service-ca 4.18.9 True False False 47s storage 4.18.9 True False False 79s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 62s csi-snapshot-controller 4.18.9 True False False 12m dns 4.18.9 True False False 65s image-registry 4.18.9 True False False 58s ingress 4.18.9 True False False 49s insights 4.18.9 True False False 110s kube-apiserver 4.18.9 True False False 11m kube-controller-manager 4.18.9 True False False 11m kube-scheduler 4.18.9 True False False 11m kube-storage-version-migrator 4.18.9 True False False 104s monitoring Unknown True Unknown 83s Rolling out the stack. network 4.18.9 True False False 11m node-tuning 4.18.9 True False False 2m19s openshift-apiserver 4.18.9 True False False 11m openshift-controller-manager 4.18.9 True False False 11m openshift-samples 4.18.9 True False False 49s operator-lifecycle-manager 4.18.9 True False False 12m operator-lifecycle-manager-catalog 4.18.9 True False False 11m operator-lifecycle-manager-packageserver 4.18.9 True False False 11m service-ca 4.18.9 True False False 107s storage 4.18.9 True False False 2m19s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 2m2s csi-snapshot-controller 4.18.9 True False False 13m dns 4.18.9 True False False 2m5s image-registry 4.18.9 True False False 118s ingress 4.18.9 True False False 109s insights 4.18.9 True False False 2m50s kube-apiserver 4.18.9 True False False 12m kube-controller-manager 4.18.9 True False False 12m kube-scheduler 4.18.9 True False False 12m kube-storage-version-migrator 4.18.9 True False False 2m44s monitoring 4.18.9 True False False 49s network 4.18.9 True False False 12m node-tuning 4.18.9 True False False 3m19s openshift-apiserver 4.18.9 True False False 12m openshift-controller-manager 4.18.9 True False False 12m openshift-samples 4.18.9 True False False 109s operator-lifecycle-manager 4.18.9 True False False 13m operator-lifecycle-manager-catalog 4.18.9 True False False 12m operator-lifecycle-manager-packageserver 4.18.9 True False False 12m service-ca 4.18.9 True False False 2m47s storage 4.18.9 True False False 3m19s Waiting for cluster to be reported as healthy... Trying again in 60s healthy cluster to be reported as healthy finished!