INFO: Log in to your Red Hat account... INFO: Configure AWS Credentials... WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. INFO: Logged in as 'rhtap-shared' on 'https://api.openshift.com' INFO: Create ROSA with HCP cluster... WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. INFO: Creating cluster 'kx-29bd08d30b' INFO: To view a list of clusters and their status, run 'rosa list clusters' INFO: Cluster 'kx-29bd08d30b' has been created. INFO: Once the cluster is installed you will need to add an Identity Provider before you can login into the cluster. See 'rosa create idp --help' for more information. Name: kx-29bd08d30b Domain Prefix: kx-29bd08d30b Display Name: kx-29bd08d30b ID: 2pabjk1o0k4lirtjul81bm4bi3nfk4gj External ID: 5805b10e-5148-4809-9982-61834fbb4ee4 Control Plane: ROSA Service Hosted OpenShift Version: 4.21.6 Channel Group: stable DNS: Not ready AWS Account: 381492310364 AWS Billing Account: 381492310364 API URL: Console URL: Region: us-east-1 Availability: - Control Plane: MultiAZ - Data Plane: MultiAZ Nodes: - Compute (desired): 3 - Compute (current): 0 Network: - Type: OVNKubernetes - Service CIDR: 172.30.0.0/16 - Machine CIDR: 10.0.0.0/16 - Pod CIDR: 10.128.0.0/14 - Host Prefix: /23 - Subnets: subnet-0208a6297964e4fe1, subnet-0c161c939f7025e15, subnet-023e5c7b3016ed194, subnet-02dbd8abbf884d77f, subnet-0360c2d20442c5ba5, subnet-0aad9c992e402a91a EC2 Metadata Http Tokens: optional Role (STS) ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Installer-Role Support Role ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Support-Role Instance IAM Roles: - Worker: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Worker-Role Operator IAM Roles: - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kms-provider - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kube-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-openshift-image-registry-installer-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-ingress-operator-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cluster-csi-drivers-ebs-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cloud-network-config-controller-cloud-creden - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-capa-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-control-plane-operator Managed Policies: Yes State: waiting (Waiting for user action) Private: No Delete Protection: Disabled Created: Mar 27 2026 22:42:27 UTC Details Page: https://console.redhat.com/openshift/details/s/3BY1mLupqydon3AeotfZ8fGbi9U OIDC Endpoint URL: https://oidc.op1.openshiftapps.com/2jtsga3i2etnl697l7bk5i1kmbm4a95j (Managed) Etcd Encryption: Disabled Audit Log Forwarding: Disabled External Authentication: Disabled Zero Egress: Disabled INFO: Preparing to create operator roles. INFO: Operator Roles already exists INFO: Preparing to create OIDC Provider. INFO: OIDC provider already exists INFO: To determine when your cluster is Ready, run 'rosa describe cluster -c kx-29bd08d30b'. INFO: To watch your cluster installation logs, run 'rosa logs install -c kx-29bd08d30b --watch'. INFO: Track the progress of the cluster creation... WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. W: Region flag will be removed from this command in future versions INFO: Cluster 'kx-29bd08d30b' is in waiting state waiting for installation to begin. Logs will show up within 5 minutes 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-29bd08d30b Version 2026-03-27 22:46:55 +0000 UTC hostedclusters kx-29bd08d30b ValidAWSIdentityProvider StatusUnknown 2026-03-27 22:46:56 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2026-03-27 22:46:56 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Ignition server deployment not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is supported by operator configuration 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Release image is valid 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation active on resource 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Ignition server deployment not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is supported by operator configuration 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Release image is valid 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation active on resource 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Ignition server deployment not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is supported by operator configuration 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Release image is valid 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation active on resource 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Ignition server deployment not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is supported by operator configuration 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Release image is valid 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation active on resource 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Ignition server deployment not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is supported by operator configuration 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Release image is valid 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation active on resource 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Ignition server deployment not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Condition not found in the CVO. 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is at expected version 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is supported by operator configuration 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Release image is valid 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation active on resource 2026-03-27 22:48:21 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2026-03-27 22:48:30 +0000 UTC hostedclusters kx-29bd08d30b Required platform credentials are found 2026-03-27 22:48:30 +0000 UTC hostedclusters kx-29bd08d30b Configuration passes validation 2026-03-27 22:48:30 +0000 UTC hostedclusters kx-29bd08d30b Required platform credentials are found 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b router load balancer is not provisioned: Error syncing load balancer: failed to ensure load balancer: error trying to register targets in target group: "InvalidTarget: The following targets are not in a running state and cannot be registered: 'i-09748bee2302fc6ed'\n\tstatus code: 400, request id: fb9e3d1b-c8f5-4def-8b65-e5e3354deb69"; private-router load balancer is not provisioned: Error syncing load balancer: failed to ensure load balancer: error trying to register targets in target group: "InvalidTarget: The following targets are not in a running state and cannot be registered: 'i-09748bee2302fc6ed'\n\tstatus code: 400, request id: 6f8b3d4d-618e-45c6-84e6-9a39916c88bc"; router load balancer is not provisioned: Error syncing load balancer: failed to ensure load balancer: error trying to register targets in target group: "InvalidTarget: The following targets are not in a running state and cannot be registered: 'i-09748bee2302fc6ed'\n\tstatus code: 400, request id: fb9e3d1b-c8f5-4def-8b65-e5e3354deb69" 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b lookup api.kx-29bd08d30b.dkgr.p3.openshiftapps.com on 172.30.0.10:53: no such host 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b OIDC configuration is valid 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b Configuration passes validation 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b capi-provider deployment has 1 unavailable replicas 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b AWS KMS is not configured 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b EtcdAvailable StatefulSetNotFound 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation completed successfully 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b Kube APIServer deployment not found 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b OIDC configuration is valid 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b AWS KMS is not configured 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b Configuration passes validation 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b lookup api.kx-29bd08d30b.dkgr.p3.openshiftapps.com on 172.30.0.10:53: no such host 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b EtcdAvailable StatefulSetNotFound 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation completed successfully 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b capi-provider deployment has 1 unavailable replicas 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b private-router load balancer is not provisioned: Error syncing load balancer: failed to ensure load balancer: error trying to register targets in target group: "InvalidTarget: The following targets are not in a running state and cannot be registered: 'i-09748bee2302fc6ed'\n\tstatus code: 400, request id: 6928fb54-7d48-4794-9761-cc9b23a94c24" 2026-03-27 22:51:10 +0000 UTC hostedclusters kx-29bd08d30b All is well 2026-03-27 22:51:20 +0000 UTC hostedclusters kx-29bd08d30b All is well 2026-03-27 22:51:32 +0000 UTC hostedclusters kx-29bd08d30b EtcdAvailable QuorumAvailable 2026-03-27 22:52:06 +0000 UTC hostedclusters kx-29bd08d30b Kube APIServer deployment is available 2026-03-27 22:52:08 +0000 UTC hostedclusters kx-29bd08d30b Ignition server deployment is available 2026-03-27 22:52:52 +0000 UTC hostedclusters kx-29bd08d30b All is well 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-29bd08d30b Version 2026-03-27 22:46:55 +0000 UTC hostedclusters kx-29bd08d30b Cannot validate AWS identity provider while KubeAPIServer is not available 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is at expected version 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation active on resource 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Waiting for components to be available: cloud-credential-operator, cluster-network-operator, hosted-cluster-config-operator 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Release image is valid 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is supported by operator configuration 2026-03-27 22:48:21 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2026-03-27 22:48:30 +0000 UTC hostedclusters kx-29bd08d30b Configuration passes validation 2026-03-27 22:48:30 +0000 UTC hostedclusters kx-29bd08d30b Required platform credentials are found 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b Configuration passes validation 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b AWS KMS is not configured 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b [cloud-credential-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ignition-server-proxy deployment has 2 unavailable replicas, kube-controller-manager deployment has 1 unavailable replicas] 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation completed successfully 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b OIDC configuration is valid 2026-03-27 22:51:10 +0000 UTC hostedclusters kx-29bd08d30b All is well 2026-03-27 22:51:20 +0000 UTC hostedclusters kx-29bd08d30b All is well 2026-03-27 22:51:32 +0000 UTC hostedclusters kx-29bd08d30b EtcdAvailable QuorumAvailable 2026-03-27 22:52:06 +0000 UTC hostedclusters kx-29bd08d30b Kube APIServer deployment is available 2026-03-27 22:52:08 +0000 UTC hostedclusters kx-29bd08d30b Ignition server deployment is available 2026-03-27 22:53:04 +0000 UTC hostedclusters kx-29bd08d30b An update is already in progress and the details are in the Progressing condition 2026-03-27 22:53:04 +0000 UTC hostedclusters kx-29bd08d30b ClusterVersionSucceeding FromClusterVersion 2026-03-27 22:53:04 +0000 UTC hostedclusters kx-29bd08d30b Working towards 4.21.6: 566 of 683 done (82% complete) 2026-03-27 22:53:04 +0000 UTC hostedclusters kx-29bd08d30b Payload loaded version="4.21.6" image="quay.io/openshift-release-dev/ocp-release@sha256:995462cdf4c4036ff76e6ca73a69dc671bb017134c7486725d7da3cbe0330c5f" architecture="Multi" 2026-03-27 22:53:04 +0000 UTC hostedclusters kx-29bd08d30b ClusterVersionAvailable FromClusterVersion 2026-03-27 22:53:24 +0000 UTC hostedclusters kx-29bd08d30b lookup api.kx-29bd08d30b.dkgr.p3.openshiftapps.com on 172.30.0.10:53: no such host 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-29bd08d30b Version 2026-03-27 22:46:55 +0000 UTC hostedclusters kx-29bd08d30b Cannot validate AWS identity provider while KubeAPIServer is not available 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is at expected version 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation active on resource 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b Release image is valid 2026-03-27 22:46:57 +0000 UTC hostedclusters kx-29bd08d30b HostedCluster is supported by operator configuration 2026-03-27 22:48:21 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2026-03-27 22:48:30 +0000 UTC hostedclusters kx-29bd08d30b Configuration passes validation 2026-03-27 22:48:30 +0000 UTC hostedclusters kx-29bd08d30b Required platform credentials are found 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b Configuration passes validation 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b AWS KMS is not configured 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b ignition-server-proxy deployment has 1 unavailable replicas 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b Reconciliation completed successfully 2026-03-27 22:48:33 +0000 UTC hostedclusters kx-29bd08d30b OIDC configuration is valid 2026-03-27 22:51:10 +0000 UTC hostedclusters kx-29bd08d30b All is well 2026-03-27 22:51:20 +0000 UTC hostedclusters kx-29bd08d30b All is well 2026-03-27 22:51:32 +0000 UTC hostedclusters kx-29bd08d30b EtcdAvailable QuorumAvailable 2026-03-27 22:52:06 +0000 UTC hostedclusters kx-29bd08d30b Kube APIServer deployment is available 2026-03-27 22:52:08 +0000 UTC hostedclusters kx-29bd08d30b Ignition server deployment is available 2026-03-27 22:53:04 +0000 UTC hostedclusters kx-29bd08d30b An update is already in progress and the details are in the Progressing condition 2026-03-27 22:53:04 +0000 UTC hostedclusters kx-29bd08d30b Payload loaded version="4.21.6" image="quay.io/openshift-release-dev/ocp-release@sha256:995462cdf4c4036ff76e6ca73a69dc671bb017134c7486725d7da3cbe0330c5f" architecture="Multi" 2026-03-27 22:53:04 +0000 UTC hostedclusters kx-29bd08d30b ClusterVersionAvailable FromClusterVersion 2026-03-27 22:53:04 +0000 UTC hostedclusters kx-29bd08d30b Unable to apply 4.21.6: some cluster operators are not available 2026-03-27 22:53:30 +0000 UTC hostedclusters kx-29bd08d30b Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, network, node-tuning, openshift-samples, service-ca, storage are not available 2026-03-27 22:53:32 +0000 UTC hostedclusters kx-29bd08d30b The hosted control plane is available INFO: Cluster 'kx-29bd08d30b' is now ready INFO: ROSA with HCP cluster is ready, create a cluster admin account for accessing the cluster WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. INFO: Storing login command... INFO: Check if it's able to login to OCP cluster... Retried 1 times... INFO: Check if apiserver is ready... Waiting for cluster operators to be accessible for 2m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.6 True False False 3m37s dns 4.21.6 False False True 3m40s DNS "default" is unavailable. image-registry False True True 3m28s Available: The deployment does not have available replicas... ingress False True True 3m20s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.21.6 True False False 3m33s kube-controller-manager 4.21.6 True False False 3m33s kube-scheduler 4.21.6 True False False 3m33s kube-storage-version-migrator monitoring network 4.21.6 True True False 3m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 3m30s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.21.6 True False False 3m33s openshift-controller-manager 4.21.6 True False False 3m33s openshift-samples operator-lifecycle-manager 4.21.6 True False False 3m35s operator-lifecycle-manager-catalog 4.21.6 True False False 3m27s operator-lifecycle-manager-packageserver 4.21.6 True False False 3m33s service-ca storage 4.21.6 False True False 3m33s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service cluster operators to be accessible finished! [INFO] Cluster operators are accessible. Waiting for cluster to be reported as healthy for 60m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.6 True False False 3m37s dns 4.21.6 False False True 3m40s DNS "default" is unavailable. image-registry False True True 3m28s Available: The deployment does not have available replicas... ingress False True True 3m20s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.21.6 True False False 3m33s kube-controller-manager 4.21.6 True False False 3m33s kube-scheduler 4.21.6 True False False 3m33s kube-storage-version-migrator monitoring network 4.21.6 True True False 3m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 3m30s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.21.6 True False False 3m33s openshift-controller-manager 4.21.6 True False False 3m33s openshift-samples operator-lifecycle-manager 4.21.6 True False False 3m35s operator-lifecycle-manager-catalog 4.21.6 True False False 3m27s operator-lifecycle-manager-packageserver 4.21.6 True False False 3m33s service-ca storage 4.21.6 False True False 3m33s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.6 True False False 4m37s dns 4.21.6 False False True 4m40s DNS "default" is unavailable. image-registry False True True 4m28s Available: The deployment does not have available replicas... ingress False True True 4m20s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.21.6 True False False 4m33s kube-controller-manager 4.21.6 True False False 4m33s kube-scheduler 4.21.6 True False False 4m33s kube-storage-version-migrator monitoring network 4.21.6 True True False 4m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 4m30s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.21.6 True False False 4m33s openshift-controller-manager 4.21.6 True False False 4m33s openshift-samples operator-lifecycle-manager 4.21.6 True False False 4m35s operator-lifecycle-manager-catalog 4.21.6 True False False 4m27s operator-lifecycle-manager-packageserver 4.21.6 True False False 4m33s service-ca storage 4.21.6 False True False 4m33s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.6 True False False 5m38s dns 4.21.6 False False True 5m41s DNS "default" is unavailable. image-registry False True True 5m29s Available: The deployment does not have available replicas... ingress False True True 5m21s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.21.6 True False False 5m34s kube-controller-manager 4.21.6 True False False 5m34s kube-scheduler 4.21.6 True False False 5m34s kube-storage-version-migrator monitoring network 4.21.6 True True False 5m1s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning 4.21.6 True True False 11s Waiting for 3/3 Profiles to be applied openshift-apiserver 4.21.6 True False False 5m34s openshift-controller-manager 4.21.6 True False False 5m34s openshift-samples operator-lifecycle-manager 4.21.6 True False False 5m36s operator-lifecycle-manager-catalog 4.21.6 True False False 5m28s operator-lifecycle-manager-packageserver 4.21.6 True False False 5m34s service-ca storage 4.21.6 True True False 13s VolumeDataSourceValidatorDeploymentControllerProgressing: Waiting for Deployment to deploy pods Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.6 True False False 6m38s dns 4.21.6 False True True 6m41s DNS "default" is unavailable. image-registry False True True 6m29s Available: The deployment does not have available replicas... ingress False True True 6m21s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights 4.21.6 True False False 8s kube-apiserver 4.21.6 True False False 6m34s kube-controller-manager 4.21.6 True False False 6m34s kube-scheduler 4.21.6 True False False 6m34s kube-storage-version-migrator 4.21.6 True False False 6s monitoring network 4.21.6 True True False 6m1s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning 4.21.6 True False False 71s openshift-apiserver 4.21.6 True False False 6m34s openshift-controller-manager 4.21.6 True False False 6m34s openshift-samples operator-lifecycle-manager 4.21.6 True False False 6m36s operator-lifecycle-manager-catalog 4.21.6 True False False 6m28s operator-lifecycle-manager-packageserver 4.21.6 True False False 6m34s service-ca 4.21.6 True False False 6s storage 4.21.6 True False False 73s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.21.6 Unknown False False 22s csi-snapshot-controller 4.21.6 True False False 7m38s dns 4.21.6 True True False 33s DNS "default" reports Progressing=True: "Have 2 available DNS pods, want 3." image-registry 4.21.6 True False False 35s ingress 4.21.6 True False False 12s insights 4.21.6 True False False 68s kube-apiserver 4.21.6 True False False 7m34s kube-controller-manager 4.21.6 True False False 7m34s kube-scheduler 4.21.6 True False False 7m34s kube-storage-version-migrator 4.21.6 True False False 66s monitoring Unknown True Unknown 41s Rolling out the stack. network 4.21.6 True False False 7m1s node-tuning 4.21.6 True False False 2m11s openshift-apiserver 4.21.6 True False False 7m34s openshift-controller-manager 4.21.6 True False False 7m34s openshift-samples 4.21.6 True False False 25s operator-lifecycle-manager 4.21.6 True False False 7m36s operator-lifecycle-manager-catalog 4.21.6 True False False 7m28s operator-lifecycle-manager-packageserver 4.21.6 True False False 7m34s service-ca 4.21.6 True False False 66s storage 4.21.6 True False False 2m13s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.21.6 True True False 55s SyncLoopRefreshProgressing: working toward version 4.21.6, 1 replicas available csi-snapshot-controller 4.21.6 True False False 8m38s dns 4.21.6 True False False 93s image-registry 4.21.6 True False False 95s ingress 4.21.6 True False False 72s insights 4.21.6 True False False 2m8s kube-apiserver 4.21.6 True False False 8m34s kube-controller-manager 4.21.6 True False False 8m34s kube-scheduler 4.21.6 True False False 8m34s kube-storage-version-migrator 4.21.6 True False False 2m6s monitoring Unknown True Unknown 101s Rolling out the stack. network 4.21.6 True False False 8m1s node-tuning 4.21.6 True False False 3m11s openshift-apiserver 4.21.6 True False False 8m34s openshift-controller-manager 4.21.6 True False False 8m34s openshift-samples 4.21.6 True False False 85s operator-lifecycle-manager 4.21.6 True False False 8m36s operator-lifecycle-manager-catalog 4.21.6 True False False 8m28s operator-lifecycle-manager-packageserver 4.21.6 True False False 8m34s service-ca 4.21.6 True False False 2m6s storage 4.21.6 True False False 3m13s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.21.6 True False False 116s csi-snapshot-controller 4.21.6 True False False 9m39s dns 4.21.6 True False False 2m34s image-registry 4.21.6 True False False 2m36s ingress 4.21.6 True False False 2m13s insights 4.21.6 True False False 3m9s kube-apiserver 4.21.6 True False False 9m35s kube-controller-manager 4.21.6 True False False 9m35s kube-scheduler 4.21.6 True False False 9m35s kube-storage-version-migrator 4.21.6 True False False 3m7s monitoring Unknown True Unknown 2m42s Rolling out the stack. network 4.21.6 True False False 9m2s node-tuning 4.21.6 True False False 4m12s openshift-apiserver 4.21.6 True False False 9m35s openshift-controller-manager 4.21.6 True False False 9m35s openshift-samples 4.21.6 True False False 2m26s operator-lifecycle-manager 4.21.6 True False False 9m37s operator-lifecycle-manager-catalog 4.21.6 True False False 9m29s operator-lifecycle-manager-packageserver 4.21.6 True False False 9m35s service-ca 4.21.6 True False False 3m7s storage 4.21.6 True False False 4m14s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.21.6 True False False 2m56s csi-snapshot-controller 4.21.6 True False False 10m dns 4.21.6 True False False 3m34s image-registry 4.21.6 True False False 3m36s ingress 4.21.6 True False False 3m13s insights 4.21.6 True False False 4m9s kube-apiserver 4.21.6 True False False 10m kube-controller-manager 4.21.6 True False False 10m kube-scheduler 4.21.6 True False False 10m kube-storage-version-migrator 4.21.6 True False False 4m7s monitoring Unknown True Unknown 3m42s Rolling out the stack. network 4.21.6 True False False 10m node-tuning 4.21.6 True False False 5m12s openshift-apiserver 4.21.6 True False False 10m openshift-controller-manager 4.21.6 True False False 10m openshift-samples 4.21.6 True False False 3m26s operator-lifecycle-manager 4.21.6 True False False 10m operator-lifecycle-manager-catalog 4.21.6 True False False 10m operator-lifecycle-manager-packageserver 4.21.6 True False False 10m service-ca 4.21.6 True False False 4m7s storage 4.21.6 True False False 5m14s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.21.6 True False False 3m56s csi-snapshot-controller 4.21.6 True False False 11m dns 4.21.6 True False False 4m34s image-registry 4.21.6 True False False 4m36s ingress 4.21.6 True False False 4m13s insights 4.21.6 True False False 5m9s kube-apiserver 4.21.6 True False False 11m kube-controller-manager 4.21.6 True False False 11m kube-scheduler 4.21.6 True False False 11m kube-storage-version-migrator 4.21.6 True False False 5m7s monitoring 4.21.6 True False False 60s network 4.21.6 True False False 11m node-tuning 4.21.6 True False False 6m12s openshift-apiserver 4.21.6 True False False 11m openshift-controller-manager 4.21.6 True False False 11m openshift-samples 4.21.6 True False False 4m26s operator-lifecycle-manager 4.21.6 True False False 11m operator-lifecycle-manager-catalog 4.21.6 True False False 11m operator-lifecycle-manager-packageserver 4.21.6 True False False 11m service-ca 4.21.6 True False False 5m7s storage 4.21.6 True False False 6m14s Waiting for cluster to be reported as healthy... Trying again in 60s healthy cluster to be reported as healthy finished!