INFO: Log in to your Red Hat account... INFO: Configure AWS Credentials... WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. INFO: Logged in as 'rhtap-shared' on 'https://api.openshift.com' INFO: Create ROSA with HCP cluster... WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. INFO: Creating cluster 'kx-dc35fd4ddb' INFO: To view a list of clusters and their status, run 'rosa list clusters' INFO: Cluster 'kx-dc35fd4ddb' has been created. INFO: Once the cluster is installed you will need to add an Identity Provider before you can login into the cluster. See 'rosa create idp --help' for more information. Name: kx-dc35fd4ddb Domain Prefix: kx-dc35fd4ddb Display Name: kx-dc35fd4ddb ID: 2pvn461a2e3dg73kigr9ohvaqf1urjn8 External ID: b6dbc20b-4b61-4869-b129-eabfca9d3c9d Control Plane: ROSA Service Hosted OpenShift Version: 4.21.9 Channel Group: stable DNS: Not ready AWS Account: 381492310364 AWS Billing Account: 381492310364 API URL: Console URL: Region: us-east-1 Availability: - Control Plane: MultiAZ - Data Plane: MultiAZ Nodes: - Compute (desired): 3 - Compute (current): 0 Network: - Type: OVNKubernetes - Service CIDR: 172.30.0.0/16 - Machine CIDR: 10.0.0.0/16 - Pod CIDR: 10.128.0.0/14 - Host Prefix: /23 - Subnets: subnet-0208a6297964e4fe1, subnet-0c161c939f7025e15, subnet-023e5c7b3016ed194, subnet-02dbd8abbf884d77f, subnet-0360c2d20442c5ba5, subnet-0aad9c992e402a91a EC2 Metadata Http Tokens: optional Role (STS) ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Installer-Role Support Role ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Support-Role Instance IAM Roles: - Worker: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Worker-Role Operator IAM Roles: - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kms-provider - arn:aws:iam::381492310364:role/rhads-hcp-openshift-image-registry-installer-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-ingress-operator-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cluster-csi-drivers-ebs-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cloud-network-config-controller-cloud-creden - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kube-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-capa-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-control-plane-operator Managed Policies: Yes State: waiting (Waiting for user action) Private: No Delete Protection: Disabled Created: Apr 29 2026 08:23:55 UTC Details Page: https://console.redhat.com/openshift/details/s/3D1YRVtn3nVDxd0ubABLEE219yt OIDC Endpoint URL: https://oidc.op1.openshiftapps.com/2jtsga3i2etnl697l7bk5i1kmbm4a95j (Managed) Etcd Encryption: Disabled Audit Log Forwarding: Disabled External Authentication: Disabled INFO: Preparing to create operator roles. INFO: Operator Roles already exists INFO: Preparing to create OIDC Provider. INFO: OIDC provider already exists INFO: To determine when your cluster is Ready, run 'rosa describe cluster -c kx-dc35fd4ddb'. INFO: To watch your cluster installation logs, run 'rosa logs install -c kx-dc35fd4ddb --watch'. INFO: Track the progress of the cluster creation... WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. W: Region flag will be removed from this command in future versions INFO: Cluster 'kx-dc35fd4ddb' is in waiting state waiting for installation to begin. Logs will show up within 5 minutes 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-dc35fd4ddb Version 2026-04-29 08:27:51 +0000 UTC hostedclusters kx-dc35fd4ddb ValidAWSIdentityProvider StatusUnknown 2026-04-29 08:27:52 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2026-04-29 08:27:52 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Ignition server deployment not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is supported by operator configuration 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Release image is valid 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation active on resource 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Ignition server deployment not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is supported by operator configuration 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Release image is valid 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation active on resource 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Ignition server deployment not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is supported by operator configuration 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Release image is valid 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation active on resource 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Ignition server deployment not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is supported by operator configuration 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Release image is valid 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation active on resource 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Ignition server deployment not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is supported by operator configuration 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Release image is valid 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation active on resource 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-dc35fd4ddb Version 2026-04-29 08:27:51 +0000 UTC hostedclusters kx-dc35fd4ddb ValidAWSIdentityProvider StatusUnknown 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Release image is valid 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the HCP 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is at expected version 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation active on resource 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Ignition server deployment not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is supported by operator configuration 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb router load balancer is not provisioned; 2s since creation.; private-router load balancer is not provisioned; 2s since creation.; router load balancer is not provisioned; 2s since creation. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:29:22 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2026-04-29 08:29:28 +0000 UTC hostedclusters kx-dc35fd4ddb Configuration passes validation 2026-04-29 08:29:28 +0000 UTC hostedclusters kx-dc35fd4ddb Required platform credentials are found 2026-04-29 08:29:30 +0000 UTC hostedclusters kx-dc35fd4ddb OIDC configuration is valid 2026-04-29 08:29:30 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation completed successfully 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb router load balancer is not provisioned; 2s since creation.; private-router load balancer is not provisioned; 2s since creation.; router load balancer is not provisioned; 2s since creation. 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb lookup api.kx-dc35fd4ddb.hq1f.p3.openshiftapps.com on 172.30.0.10:53: no such host 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb Configuration passes validation 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb capi-provider deployment has 1 unavailable replicas 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb AWS KMS is not configured 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb EtcdAvailable StatefulSetNotFound 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb Kube APIServer deployment not found 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-dc35fd4ddb Version 2026-04-29 08:27:51 +0000 UTC hostedclusters kx-dc35fd4ddb Cannot validate AWS identity provider while KubeAPIServer is not available 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Release image is valid 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Ignition server deployment not found 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is at expected version 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation active on resource 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is supported by operator configuration 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Condition not found in the CVO. 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Waiting for Kube APIServer deployment to become available 2026-04-29 08:29:22 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2026-04-29 08:29:28 +0000 UTC hostedclusters kx-dc35fd4ddb Required platform credentials are found 2026-04-29 08:29:28 +0000 UTC hostedclusters kx-dc35fd4ddb Configuration passes validation 2026-04-29 08:29:30 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation completed successfully 2026-04-29 08:29:30 +0000 UTC hostedclusters kx-dc35fd4ddb OIDC configuration is valid 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb Waiting for Kube APIServer deployment to become available 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb Configuration passes validation 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb AWS KMS is not configured 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb lookup api.kx-dc35fd4ddb.hq1f.p3.openshiftapps.com on 172.30.0.10:53: no such host 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb [capi-provider deployment has 2 unavailable replicas, kube-apiserver deployment has 2 unavailable replicas] 2026-04-29 08:30:38 +0000 UTC hostedclusters kx-dc35fd4ddb All is well 2026-04-29 08:30:38 +0000 UTC hostedclusters kx-dc35fd4ddb All is well 2026-04-29 08:30:58 +0000 UTC hostedclusters kx-dc35fd4ddb EtcdAvailable QuorumAvailable 2026-04-29 08:31:27 +0000 UTC hostedclusters kx-dc35fd4ddb Kube APIServer deployment is available 2026-04-29 08:31:35 +0000 UTC hostedclusters kx-dc35fd4ddb Ignition server deployment is available 2026-04-29 08:32:12 +0000 UTC hostedclusters kx-dc35fd4ddb ClusterVersionSucceeding FromClusterVersion 2026-04-29 08:32:12 +0000 UTC hostedclusters kx-dc35fd4ddb An update is already in progress and the details are in the Progressing condition 2026-04-29 08:32:12 +0000 UTC hostedclusters kx-dc35fd4ddb Working towards 4.21.9: 429 of 683 done (62% complete) 2026-04-29 08:32:12 +0000 UTC hostedclusters kx-dc35fd4ddb Payload loaded version="4.21.9" image="quay.io/openshift-release-dev/ocp-release@sha256:874cb62361d692ccf74dfd3ed5a76832dbde51815e96f6b0f32fab137e59b36a" architecture="Multi" 2026-04-29 08:32:12 +0000 UTC hostedclusters kx-dc35fd4ddb ClusterVersionAvailable FromClusterVersion 2026-04-29 08:32:22 +0000 UTC hostedclusters kx-dc35fd4ddb All is well 2026-04-29 08:32:31 +0000 UTC hostedclusters kx-dc35fd4ddb Multiple errors are preventing progress: * Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, network, node-tuning, openshift-samples, service-ca, storage are not available * Could not update imagestream "openshift/driver-toolkit" (484 of 683): resource may have been deleted * Could not update operatorgroup "openshift-monitoring/openshift-cluster-monitoring" (623 of 683): resource may have been deleted * Could not update role "openshift-authentication/prometheus-k8s" (609 of 683): resource may have been deleted * Could not update role "openshift-console-operator/prometheus-k8s" (641 of 683): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (645 of 683): resource may have been deleted * Could not update role "openshift-ingress-operator/prometheus-k8s" (652 of 683): resource may have been deleted * Could not update role "openshift-kube-apiserver-operator/prometheus-k8s" (656 of 683): resource may have been deleted 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-dc35fd4ddb Version 2026-04-29 08:27:51 +0000 UTC hostedclusters kx-dc35fd4ddb Cannot validate AWS identity provider while KubeAPIServer is not available 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is at expected version 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation active on resource 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb Release image is valid 2026-04-29 08:27:53 +0000 UTC hostedclusters kx-dc35fd4ddb HostedCluster is supported by operator configuration 2026-04-29 08:29:22 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2026-04-29 08:29:28 +0000 UTC hostedclusters kx-dc35fd4ddb Configuration passes validation 2026-04-29 08:29:28 +0000 UTC hostedclusters kx-dc35fd4ddb Required platform credentials are found 2026-04-29 08:29:30 +0000 UTC hostedclusters kx-dc35fd4ddb Reconciliation completed successfully 2026-04-29 08:29:30 +0000 UTC hostedclusters kx-dc35fd4ddb OIDC configuration is valid 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb Configuration passes validation 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb AWS KMS is not configured 2026-04-29 08:29:31 +0000 UTC hostedclusters kx-dc35fd4ddb ignition-server-proxy deployment has 1 unavailable replicas 2026-04-29 08:30:38 +0000 UTC hostedclusters kx-dc35fd4ddb All is well 2026-04-29 08:30:38 +0000 UTC hostedclusters kx-dc35fd4ddb All is well 2026-04-29 08:30:58 +0000 UTC hostedclusters kx-dc35fd4ddb EtcdAvailable QuorumAvailable 2026-04-29 08:31:27 +0000 UTC hostedclusters kx-dc35fd4ddb Kube APIServer deployment is available 2026-04-29 08:31:35 +0000 UTC hostedclusters kx-dc35fd4ddb Ignition server deployment is available 2026-04-29 08:32:12 +0000 UTC hostedclusters kx-dc35fd4ddb Unable to apply 4.21.9: some cluster operators are not available 2026-04-29 08:32:12 +0000 UTC hostedclusters kx-dc35fd4ddb An update is already in progress and the details are in the Progressing condition 2026-04-29 08:32:12 +0000 UTC hostedclusters kx-dc35fd4ddb ClusterVersionAvailable FromClusterVersion 2026-04-29 08:32:12 +0000 UTC hostedclusters kx-dc35fd4ddb Payload loaded version="4.21.9" image="quay.io/openshift-release-dev/ocp-release@sha256:874cb62361d692ccf74dfd3ed5a76832dbde51815e96f6b0f32fab137e59b36a" architecture="Multi" 2026-04-29 08:32:44 +0000 UTC hostedclusters kx-dc35fd4ddb The hosted control plane is available INFO: Cluster 'kx-dc35fd4ddb' is now ready INFO: ROSA with HCP cluster is ready, create a cluster admin account for accessing the cluster WARN: The current version (1.2.59) is not up to date with latest rosa cli released version (1.2.61). WARN: It is recommended that you update to the latest version. INFO: Storing login command... INFO: Check if it's able to login to OCP cluster... Retried 1 times... INFO: Check if apiserver is ready... Waiting for cluster operators to be accessible for 2m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.9 True False False 3m29s dns 4.21.9 False False True 3m29s DNS "default" is unavailable. image-registry False True True 2m38s Available: The deployment does not have available replicas... ingress False True True 3m13s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.21.9 True False False 3m20s kube-controller-manager 4.21.9 True False False 3m20s kube-scheduler 4.21.9 True False False 3m20s kube-storage-version-migrator monitoring network 4.21.9 True True False 3m5s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 2m41s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.21.9 True False False 3m20s openshift-controller-manager 4.21.9 True False False 3m20s openshift-samples operator-lifecycle-manager 4.21.9 True False False 3m22s operator-lifecycle-manager-catalog 4.21.9 True False False 3m16s operator-lifecycle-manager-packageserver 4.21.9 True False False 3m19s service-ca storage 4.21.9 False True False 3m19s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service cluster operators to be accessible finished! [INFO] Cluster operators are accessible. Waiting for cluster to be reported as healthy for 60m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.9 True False False 3m30s dns 4.21.9 False False True 3m30s DNS "default" is unavailable. image-registry False True True 2m39s Available: The deployment does not have available replicas... ingress False True True 3m14s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.21.9 True False False 3m21s kube-controller-manager 4.21.9 True False False 3m21s kube-scheduler 4.21.9 True False False 3m21s kube-storage-version-migrator monitoring network 4.21.9 True True False 3m6s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 2m42s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.21.9 True False False 3m21s openshift-controller-manager 4.21.9 True False False 3m21s openshift-samples operator-lifecycle-manager 4.21.9 True False False 3m23s operator-lifecycle-manager-catalog 4.21.9 True False False 3m17s operator-lifecycle-manager-packageserver 4.21.9 True False False 3m20s service-ca storage 4.21.9 False True False 3m20s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.9 True False False 4m30s dns 4.21.9 False False True 4m30s DNS "default" is unavailable. image-registry False True True 3m39s Available: The deployment does not have available replicas... ingress False True True 4m14s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.21.9 True False False 4m21s kube-controller-manager 4.21.9 True False False 4m21s kube-scheduler 4.21.9 True False False 4m21s kube-storage-version-migrator monitoring network 4.21.9 True True False 4m6s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 3m42s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.21.9 True False False 4m21s openshift-controller-manager 4.21.9 True False False 4m21s openshift-samples operator-lifecycle-manager 4.21.9 True False False 4m23s operator-lifecycle-manager-catalog 4.21.9 True False False 4m17s operator-lifecycle-manager-packageserver 4.21.9 True False False 4m20s service-ca storage 4.21.9 False True False 4m20s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.9 True False False 5m30s dns 4.21.9 False False True 5m30s DNS "default" is unavailable. image-registry False True True 4m39s Available: The deployment does not have available replicas... ingress False True True 5m14s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.21.9 True False False 5m21s kube-controller-manager 4.21.9 True False False 5m21s kube-scheduler 4.21.9 True False False 5m21s kube-storage-version-migrator monitoring network 4.21.9 True True False 5m6s Deployment "/openshift-network-console/networking-console-plugin" is not available (awaiting 2 nodes) node-tuning False True False 4m42s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.21.9 True False False 5m21s openshift-controller-manager 4.21.9 True False False 5m21s openshift-samples operator-lifecycle-manager 4.21.9 True False False 5m23s operator-lifecycle-manager-catalog 4.21.9 True False False 5m17s operator-lifecycle-manager-packageserver 4.21.9 True False False 5m20s service-ca storage 4.21.9 False True False 5m20s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.9 True False False 6m31s dns 4.21.9 False False True 6m31s DNS "default" is unavailable. image-registry False True True 5m40s Available: The deployment does not have available replicas... ingress False True True 6m15s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.21.9 True False False 6m22s kube-controller-manager 4.21.9 True False False 6m22s kube-scheduler 4.21.9 True False False 6m22s kube-storage-version-migrator monitoring network 4.21.9 True True False 6m7s DaemonSet "/openshift-multus/multus" is not available (awaiting 1 nodes)... node-tuning 4.21.9 True True False 8s Waiting for 1/1 Profiles to be applied openshift-apiserver 4.21.9 True False False 6m22s openshift-controller-manager 4.21.9 True False False 6m22s openshift-samples operator-lifecycle-manager 4.21.9 True False False 6m24s operator-lifecycle-manager-catalog 4.21.9 True False False 6m18s operator-lifecycle-manager-packageserver 4.21.9 True False False 6m21s service-ca storage 4.21.9 True True False 5s VolumeDataSourceValidatorDeploymentControllerProgressing: Waiting for Deployment to deploy pods Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.21.9 True False False 7m31s dns 4.21.9 False True True 7m31s DNS "default" is unavailable. image-registry False True True 6m40s Available: The deployment does not have available replicas... ingress False True True 7m15s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights 4.21.9 True False False 30s kube-apiserver 4.21.9 True False False 7m22s kube-controller-manager 4.21.9 True False False 7m22s kube-scheduler 4.21.9 True False False 7m22s kube-storage-version-migrator 4.21.9 True False False 27s monitoring Unknown True Unknown 6s Rolling out the stack. network 4.21.9 True True False 7m7s DaemonSet "/openshift-multus/network-metrics-daemon" is not available (awaiting 2 nodes)... node-tuning 4.21.9 True True False 38s Waiting for 1/3 Profiles to be applied openshift-apiserver 4.21.9 True False False 7m22s openshift-controller-manager 4.21.9 True False False 7m22s openshift-samples operator-lifecycle-manager 4.21.9 True False False 7m24s operator-lifecycle-manager-catalog 4.21.9 True False False 7m18s operator-lifecycle-manager-packageserver 4.21.9 True False False 7m21s service-ca 4.21.9 True False False 29s storage 4.21.9 True False False 65s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.21.9 True False False 21s csi-snapshot-controller 4.21.9 True False False 8m31s dns 4.21.9 True False False 57s image-registry 4.21.9 True False False 59s ingress 4.21.9 True False False 46s insights 4.21.9 True False False 90s kube-apiserver 4.21.9 True False False 8m22s kube-controller-manager 4.21.9 True False False 8m22s kube-scheduler 4.21.9 True False False 8m22s kube-storage-version-migrator 4.21.9 True False False 87s monitoring Unknown True Unknown 66s Rolling out the stack. network 4.21.9 True False False 8m7s node-tuning 4.21.9 True False False 98s openshift-apiserver 4.21.9 True False False 8m22s openshift-controller-manager 4.21.9 True False False 8m22s openshift-samples 4.21.9 True False False 48s operator-lifecycle-manager 4.21.9 True False False 8m24s operator-lifecycle-manager-catalog 4.21.9 True False False 8m18s operator-lifecycle-manager-packageserver 4.21.9 True False False 8m21s service-ca 4.21.9 True False False 89s storage 4.21.9 True False False 2m5s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.21.9 True False False 81s csi-snapshot-controller 4.21.9 True False False 9m31s dns 4.21.9 True False False 117s image-registry 4.21.9 True False False 119s ingress 4.21.9 True False False 106s insights 4.21.9 True False False 2m30s kube-apiserver 4.21.9 True False False 9m22s kube-controller-manager 4.21.9 True False False 9m22s kube-scheduler 4.21.9 True False False 9m22s kube-storage-version-migrator 4.21.9 True False False 2m27s monitoring Unknown True Unknown 2m6s Rolling out the stack. network 4.21.9 True False False 9m7s node-tuning 4.21.9 True False False 2m38s openshift-apiserver 4.21.9 True False False 9m22s openshift-controller-manager 4.21.9 True False False 9m22s openshift-samples 4.21.9 True False False 108s operator-lifecycle-manager 4.21.9 True False False 9m24s operator-lifecycle-manager-catalog 4.21.9 True False False 9m18s operator-lifecycle-manager-packageserver 4.21.9 True False False 9m21s service-ca 4.21.9 True False False 2m29s storage 4.21.9 True False False 3m5s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.21.9 True False False 2m22s csi-snapshot-controller 4.21.9 True False False 10m dns 4.21.9 True False False 2m58s image-registry 4.21.9 True False False 3m ingress 4.21.9 True False False 2m47s insights 4.21.9 True False False 3m31s kube-apiserver 4.21.9 True False False 10m kube-controller-manager 4.21.9 True False False 10m kube-scheduler 4.21.9 True False False 10m kube-storage-version-migrator 4.21.9 True False False 3m28s monitoring Unknown True Unknown 3m7s Rolling out the stack. network 4.21.9 True False False 10m node-tuning 4.21.9 True False False 3m39s openshift-apiserver 4.21.9 True False False 10m openshift-controller-manager 4.21.9 True False False 10m openshift-samples 4.21.9 True False False 2m49s operator-lifecycle-manager 4.21.9 True False False 10m operator-lifecycle-manager-catalog 4.21.9 True False False 10m operator-lifecycle-manager-packageserver 4.21.9 True False False 10m service-ca 4.21.9 True False False 3m30s storage 4.21.9 True False False 4m6s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.21.9 True False False 3m22s csi-snapshot-controller 4.21.9 True False False 11m dns 4.21.9 True False False 3m58s image-registry 4.21.9 True False False 4m ingress 4.21.9 True False False 3m47s insights 4.21.9 True False False 4m31s kube-apiserver 4.21.9 True False False 11m kube-controller-manager 4.21.9 True False False 11m kube-scheduler 4.21.9 True False False 11m kube-storage-version-migrator 4.21.9 True False False 4m28s monitoring 4.21.9 True False False 20s network 4.21.9 True False False 11m node-tuning 4.21.9 True False False 4m39s openshift-apiserver 4.21.9 True False False 11m openshift-controller-manager 4.21.9 True False False 11m openshift-samples 4.21.9 True False False 3m49s operator-lifecycle-manager 4.21.9 True False False 11m operator-lifecycle-manager-catalog 4.21.9 True False False 11m operator-lifecycle-manager-packageserver 4.21.9 True False False 11m service-ca 4.21.9 True False False 4m30s storage 4.21.9 True False False 5m6s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.21.9 True False False 4m22s csi-snapshot-controller 4.21.9 True False False 12m dns 4.21.9 True False False 4m58s image-registry 4.21.9 True False False 5m ingress 4.21.9 True False False 4m47s insights 4.21.9 True False False 5m31s kube-apiserver 4.21.9 True False False 12m kube-controller-manager 4.21.9 True False False 12m kube-scheduler 4.21.9 True False False 12m kube-storage-version-migrator 4.21.9 True False False 5m28s monitoring 4.21.9 True False False 80s network 4.21.9 True False False 12m node-tuning 4.21.9 True False False 5m39s openshift-apiserver 4.21.9 True False False 12m openshift-controller-manager 4.21.9 True False False 12m openshift-samples 4.21.9 True False False 4m49s operator-lifecycle-manager 4.21.9 True False False 12m operator-lifecycle-manager-catalog 4.21.9 True False False 12m operator-lifecycle-manager-packageserver 4.21.9 True False False 12m service-ca 4.21.9 True False False 5m30s storage 4.21.9 True False False 6m6s Waiting for cluster to be reported as healthy... Trying again in 60s healthy cluster to be reported as healthy finished!