INFO: Log in to your Red Hat account... INFO: Configure AWS Credentials... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.57). WARN: It is recommended that you update to the latest version. INFO: Logged in as 'rhtap-shared' on 'https://api.openshift.com' INFO: Create ROSA with HCP cluster... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.57). WARN: It is recommended that you update to the latest version. INFO: Creating cluster 'kx-f2593d043f' INFO: To view a list of clusters and their status, run 'rosa list clusters' INFO: Cluster 'kx-f2593d043f' has been created. INFO: Once the cluster is installed you will need to add an Identity Provider before you can login into the cluster. See 'rosa create idp --help' for more information. Name: kx-f2593d043f Domain Prefix: kx-f2593d043f Display Name: kx-f2593d043f ID: 2md4jrbcesd88d6p10uqpen9l515a0ib External ID: 1c392828-2426-4038-b4e8-dce80d9f642d Control Plane: ROSA Service Hosted OpenShift Version: 4.19.9 Channel Group: stable DNS: Not ready AWS Account: 381492310364 AWS Billing Account: 381492310364 API URL: Console URL: Region: us-east-1 Availability: - Control Plane: MultiAZ - Data Plane: MultiAZ Nodes: - Compute (desired): 3 - Compute (current): 0 Network: - Type: OVNKubernetes - Service CIDR: 172.30.0.0/16 - Machine CIDR: 10.0.0.0/16 - Pod CIDR: 10.128.0.0/14 - Host Prefix: /23 - Subnets: subnet-0208a6297964e4fe1, subnet-0c161c939f7025e15, subnet-023e5c7b3016ed194, subnet-02dbd8abbf884d77f, subnet-0360c2d20442c5ba5, subnet-0aad9c992e402a91a EC2 Metadata Http Tokens: optional Role (STS) ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Installer-Role Support Role ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Support-Role Instance IAM Roles: - Worker: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Worker-Role Operator IAM Roles: - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kms-provider - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cluster-csi-drivers-ebs-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cloud-network-config-controller-cloud-creden - arn:aws:iam::381492310364:role/rhads-hcp-openshift-image-registry-installer-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-ingress-operator-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kube-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-capa-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-control-plane-operator Managed Policies: Yes State: waiting (Waiting for user action) Private: No Delete Protection: Disabled Created: Nov 6 2025 12:43:28 UTC [DEPRECATED] User Workload Monitoring: Enabled Details Page: https://console.redhat.com/openshift/details/s/356aWm4nubqNOpIqmKBT6JNjlnt OIDC Endpoint URL: https://oidc.op1.openshiftapps.com/2jtsga3i2etnl697l7bk5i1kmbm4a95j (Managed) Etcd Encryption: Disabled Audit Log Forwarding: Disabled External Authentication: Disabled Zero Egress: Disabled INFO: Preparing to create operator roles. INFO: Operator Roles already exists INFO: Preparing to create OIDC Provider. INFO: OIDC provider already exists INFO: To determine when your cluster is Ready, run 'rosa describe cluster -c kx-f2593d043f'. INFO: To watch your cluster installation logs, run 'rosa logs install -c kx-f2593d043f --watch'. INFO: Track the progress of the cluster creation... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.57). WARN: It is recommended that you update to the latest version. W: Region flag will be removed from this command in future versions INFO: Cluster 'kx-f2593d043f' is in waiting state waiting for installation to begin. Logs will show up within 5 minutes 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-f2593d043f Version 2025-11-06 12:47:55 +0000 UTC hostedclusters kx-f2593d043f ValidAWSIdentityProvider StatusUnknown 2025-11-06 12:47:56 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2025-11-06 12:47:56 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Ignition server deployment not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f HostedCluster is supported by operator configuration 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Release image is valid 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Reconciliation active on resource 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Ignition server deployment not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f HostedCluster is supported by operator configuration 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Release image is valid 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Reconciliation active on resource 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Ignition server deployment not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f HostedCluster is supported by operator configuration 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Release image is valid 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Reconciliation active on resource 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Ignition server deployment not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f HostedCluster is supported by operator configuration 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Release image is valid 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Reconciliation active on resource 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Ignition server deployment not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f HostedCluster is supported by operator configuration 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Release image is valid 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Reconciliation active on resource 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-f2593d043f Version 2025-11-06 12:47:55 +0000 UTC hostedclusters kx-f2593d043f ValidAWSIdentityProvider StatusUnknown 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Release image is valid 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the HCP 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f HostedCluster is at expected version 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Reconciliation active on resource 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Ignition server deployment not found 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f HostedCluster is supported by operator configuration 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f router load balancer is not provisioned; 2s since creation.; private-router load balancer is not provisioned; 2s since creation.; router load balancer is not provisioned; 2s since creation. 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Condition not found in the CVO. 2025-11-06 12:49:23 +0000 UTC hostedclusters kx-f2593d043f Configuration passes validation 2025-11-06 12:49:23 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-11-06 12:49:25 +0000 UTC hostedclusters kx-f2593d043f Required platform credentials are found 2025-11-06 12:49:27 +0000 UTC hostedclusters kx-f2593d043f router load balancer is not provisioned; 2s since creation.; private-router load balancer is not provisioned; 2s since creation.; router load balancer is not provisioned; 2s since creation. 2025-11-06 12:49:27 +0000 UTC hostedclusters kx-f2593d043f lookup api.kx-f2593d043f.3pox.p3.openshiftapps.com on 172.30.0.10:53: no such host 2025-11-06 12:49:27 +0000 UTC hostedclusters kx-f2593d043f Configuration passes validation 2025-11-06 12:49:27 +0000 UTC hostedclusters kx-f2593d043f AWS KMS is not configured 2025-11-06 12:49:27 +0000 UTC hostedclusters kx-f2593d043f EtcdAvailable StatefulSetNotFound 2025-11-06 12:49:27 +0000 UTC hostedclusters kx-f2593d043f Kube APIServer deployment not found 2025-11-06 12:49:28 +0000 UTC hostedclusters kx-f2593d043f [capi-provider deployment has 1 unavailable replicas, cluster-api deployment has 1 unavailable replicas] 2025-11-06 12:49:30 +0000 UTC hostedclusters kx-f2593d043f OIDC configuration is valid 2025-11-06 12:49:30 +0000 UTC hostedclusters kx-f2593d043f Reconciliation completed successfully 2025-11-06 12:49:50 +0000 UTC hostedclusters kx-f2593d043f All is well 2025-11-06 12:49:50 +0000 UTC hostedclusters kx-f2593d043f All is well 2025-11-06 12:49:56 +0000 UTC hostedclusters kx-f2593d043f WebIdentityErr 2025-11-06 12:50:11 +0000 UTC hostedclusters kx-f2593d043f EtcdAvailable QuorumAvailable 2025-11-06 12:50:54 +0000 UTC hostedclusters kx-f2593d043f Kube APIServer deployment is available 2025-11-06 12:51:19 +0000 UTC hostedclusters kx-f2593d043f Ignition server deployment is available 2025-11-06 12:51:27 +0000 UTC hostedclusters kx-f2593d043f All is well 2025-11-06 12:51:29 +0000 UTC hostedclusters kx-f2593d043f All is well 2025-11-06 12:51:38 +0000 UTC hostedclusters kx-f2593d043f An update is already in progress and the details are in the Progressing condition 2025-11-06 12:51:38 +0000 UTC hostedclusters kx-f2593d043f Payload loaded version="4.19.9" image="quay.io/openshift-release-dev/ocp-release@sha256:fda39a9c5701bf35da74263177d8976d4bd9205e69b9a9d5834389f71005d51a" architecture="Multi" 2025-11-06 12:51:38 +0000 UTC hostedclusters kx-f2593d043f ClusterVersionAvailable FromClusterVersion 2025-11-06 12:51:38 +0000 UTC hostedclusters kx-f2593d043f Unable to apply 4.19.9: an unknown error has occurred: MultipleErrors 2025-11-06 12:52:01 +0000 UTC hostedclusters kx-f2593d043f Multiple errors are preventing progress: * Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, network, node-tuning, openshift-samples, service-ca, storage are not available * Could not update imagestream "openshift/driver-toolkit" (447 of 629): resource may have been deleted * Could not update operatorgroup "openshift-monitoring/openshift-cluster-monitoring" (570 of 629): resource may have been deleted * Could not update role "openshift-authentication/prometheus-k8s" (557 of 629): resource may have been deleted * Could not update role "openshift-console-operator/prometheus-k8s" (587 of 629): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (591 of 629): resource may have been deleted * Could not update role "openshift-ingress-operator/prometheus-k8s" (598 of 629): resource may have been deleted * Could not update role "openshift-kube-apiserver-operator/prometheus-k8s" (602 of 629): resource may have been deleted 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-f2593d043f Version 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f HostedCluster is at expected version 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Reconciliation active on resource 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f Release image is valid 2025-11-06 12:47:58 +0000 UTC hostedclusters kx-f2593d043f HostedCluster is supported by operator configuration 2025-11-06 12:49:23 +0000 UTC hostedclusters kx-f2593d043f Configuration passes validation 2025-11-06 12:49:23 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-11-06 12:49:25 +0000 UTC hostedclusters kx-f2593d043f Required platform credentials are found 2025-11-06 12:49:27 +0000 UTC hostedclusters kx-f2593d043f Configuration passes validation 2025-11-06 12:49:27 +0000 UTC hostedclusters kx-f2593d043f AWS KMS is not configured 2025-11-06 12:49:30 +0000 UTC hostedclusters kx-f2593d043f Reconciliation completed successfully 2025-11-06 12:49:30 +0000 UTC hostedclusters kx-f2593d043f OIDC configuration is valid 2025-11-06 12:49:50 +0000 UTC hostedclusters kx-f2593d043f All is well 2025-11-06 12:49:50 +0000 UTC hostedclusters kx-f2593d043f All is well 2025-11-06 12:50:11 +0000 UTC hostedclusters kx-f2593d043f EtcdAvailable QuorumAvailable 2025-11-06 12:50:54 +0000 UTC hostedclusters kx-f2593d043f Kube APIServer deployment is available 2025-11-06 12:51:19 +0000 UTC hostedclusters kx-f2593d043f Ignition server deployment is available 2025-11-06 12:51:27 +0000 UTC hostedclusters kx-f2593d043f All is well 2025-11-06 12:51:29 +0000 UTC hostedclusters kx-f2593d043f All is well 2025-11-06 12:51:38 +0000 UTC hostedclusters kx-f2593d043f Payload loaded version="4.19.9" image="quay.io/openshift-release-dev/ocp-release@sha256:fda39a9c5701bf35da74263177d8976d4bd9205e69b9a9d5834389f71005d51a" architecture="Multi" 2025-11-06 12:51:38 +0000 UTC hostedclusters kx-f2593d043f ClusterVersionAvailable FromClusterVersion 2025-11-06 12:51:38 +0000 UTC hostedclusters kx-f2593d043f Unable to apply 4.19.9: some cluster operators are not available 2025-11-06 12:51:38 +0000 UTC hostedclusters kx-f2593d043f An update is already in progress and the details are in the Progressing condition 2025-11-06 12:52:14 +0000 UTC hostedclusters kx-f2593d043f Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available 2025-11-06 12:52:39 +0000 UTC hostedclusters kx-f2593d043f The hosted cluster is not degraded 2025-11-06 12:52:44 +0000 UTC hostedclusters kx-f2593d043f The hosted control plane is available INFO: Cluster 'kx-f2593d043f' is now ready INFO: ROSA with HCP cluster is ready, create a cluster admin account for accessing the cluster WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.57). WARN: It is recommended that you update to the latest version. INFO: Storing login command... INFO: Check if it's able to login to OCP cluster... Retried 1 times... INFO: Check if apiserver is ready... Waiting for cluster operators to be accessible for 2m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 3m37s dns 4.19.9 False False True 3m44s DNS "default" is unavailable. image-registry False True True 3m35s Available: The deployment does not have available replicas... ingress False True True 3m24s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 3m41s kube-controller-manager 4.19.9 True False False 3m41s kube-scheduler 4.19.9 True False False 3m41s kube-storage-version-migrator monitoring network 4.19.9 True True False 3m10s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 3m6s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 3m41s openshift-controller-manager 4.19.9 True False False 3m41s openshift-samples operator-lifecycle-manager 4.19.9 True False False 3m40s operator-lifecycle-manager-catalog 4.19.9 True False False 3m37s operator-lifecycle-manager-packageserver 4.19.9 True False False 3m41s service-ca storage 4.19.9 False False False 3m41s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service cluster operators to be accessible finished! [INFO] Cluster operators are accessible. Waiting for cluster to be reported as healthy for 60m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 3m37s dns 4.19.9 False False True 3m44s DNS "default" is unavailable. image-registry False True True 3m35s Available: The deployment does not have available replicas... ingress False True True 3m24s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 3m41s kube-controller-manager 4.19.9 True False False 3m41s kube-scheduler 4.19.9 True False False 3m41s kube-storage-version-migrator monitoring network 4.19.9 True True False 3m10s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 3m6s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 3m41s openshift-controller-manager 4.19.9 True False False 3m41s openshift-samples operator-lifecycle-manager 4.19.9 True False False 3m40s operator-lifecycle-manager-catalog 4.19.9 True False False 3m37s operator-lifecycle-manager-packageserver 4.19.9 True False False 3m41s service-ca storage 4.19.9 False False False 3m41s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 4m37s dns 4.19.9 False False True 4m44s DNS "default" is unavailable. image-registry False True True 4m35s Available: The deployment does not have available replicas... ingress False True True 4m24s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 4m41s kube-controller-manager 4.19.9 True False False 4m41s kube-scheduler 4.19.9 True False False 4m41s kube-storage-version-migrator monitoring network 4.19.9 True True False 4m10s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 4m6s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 4m41s openshift-controller-manager 4.19.9 True False False 4m41s openshift-samples operator-lifecycle-manager 4.19.9 True False False 4m40s operator-lifecycle-manager-catalog 4.19.9 True False False 4m37s operator-lifecycle-manager-packageserver 4.19.9 True False False 4m41s service-ca storage 4.19.9 False False False 4m41s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 5m38s dns 4.19.9 False False True 5m45s DNS "default" is unavailable. image-registry False True True 5m36s Available: The deployment does not have available replicas... ingress False True True 5m25s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 5m42s kube-controller-manager 4.19.9 True False False 5m42s kube-scheduler 4.19.9 True False False 5m42s kube-storage-version-migrator monitoring network 4.19.9 True True False 5m11s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 5m7s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 5m42s openshift-controller-manager 4.19.9 True False False 5m42s openshift-samples operator-lifecycle-manager 4.19.9 True False False 5m41s operator-lifecycle-manager-catalog 4.19.9 True False False 5m38s operator-lifecycle-manager-packageserver 4.19.9 True False False 5m42s service-ca storage 4.19.9 False False False 5m42s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 6m38s dns 4.19.9 False False True 6m45s DNS "default" is unavailable. image-registry False True True 6m36s Available: The deployment does not have available replicas... ingress False True True 6m25s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 6m42s kube-controller-manager 4.19.9 True False False 6m42s kube-scheduler 4.19.9 True False False 6m42s kube-storage-version-migrator monitoring network 4.19.9 True True False 6m11s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 6m7s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 6m42s openshift-controller-manager 4.19.9 True False False 6m42s openshift-samples operator-lifecycle-manager 4.19.9 True False False 6m41s operator-lifecycle-manager-catalog 4.19.9 True False False 6m38s operator-lifecycle-manager-packageserver 4.19.9 True False False 6m42s service-ca storage 4.19.9 False False False 6m42s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 7m38s dns 4.19.9 False False True 7m45s DNS "default" is unavailable. image-registry False True True 7m36s Available: The deployment does not have available replicas... ingress False True True 7m25s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 7m42s kube-controller-manager 4.19.9 True False False 7m42s kube-scheduler 4.19.9 True False False 7m42s kube-storage-version-migrator monitoring network 4.19.9 True True False 7m11s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 7m7s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 7m42s openshift-controller-manager 4.19.9 True False False 7m42s openshift-samples operator-lifecycle-manager 4.19.9 True False False 7m41s operator-lifecycle-manager-catalog 4.19.9 True False False 7m38s operator-lifecycle-manager-packageserver 4.19.9 True False False 7m42s service-ca storage 4.19.9 False False False 7m42s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 8m38s dns 4.19.9 False False True 8m45s DNS "default" is unavailable. image-registry False True True 8m36s Available: The deployment does not have available replicas... ingress False True True 8m25s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 8m42s kube-controller-manager 4.19.9 True False False 8m42s kube-scheduler 4.19.9 True False False 8m42s kube-storage-version-migrator monitoring network 4.19.9 True True False 8m11s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 8m7s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 8m42s openshift-controller-manager 4.19.9 True False False 8m42s openshift-samples operator-lifecycle-manager 4.19.9 True False False 8m41s operator-lifecycle-manager-catalog 4.19.9 True False False 8m38s operator-lifecycle-manager-packageserver 4.19.9 True False False 8m42s service-ca storage 4.19.9 False False False 8m42s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 9m39s dns 4.19.9 False False True 9m46s DNS "default" is unavailable. image-registry False True True 9m37s Available: The deployment does not have available replicas... ingress False True True 9m26s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 9m43s kube-controller-manager 4.19.9 True False False 9m43s kube-scheduler 4.19.9 True False False 9m43s kube-storage-version-migrator monitoring network 4.19.9 True True False 9m12s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning 4.19.9 True False False 21s openshift-apiserver 4.19.9 True False False 9m43s openshift-controller-manager 4.19.9 True False False 9m43s openshift-samples operator-lifecycle-manager 4.19.9 True False False 9m42s operator-lifecycle-manager-catalog 4.19.9 True False False 9m39s operator-lifecycle-manager-packageserver 4.19.9 True False False 9m43s service-ca storage 4.19.9 True False False 19s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 10m dns 4.19.9 False True True 10m DNS "default" is unavailable. image-registry False True True 10m Available: The deployment does not have available replicas... ingress False True True 10m The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 10m kube-controller-manager 4.19.9 True False False 10m kube-scheduler 4.19.9 True False False 10m kube-storage-version-migrator monitoring network 4.19.9 True True False 10m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning 4.19.9 True True False 36s Waiting for 1/3 Profiles to be applied openshift-apiserver 4.19.9 True False False 10m openshift-controller-manager 4.19.9 True False False 10m openshift-samples operator-lifecycle-manager 4.19.9 True False False 10m operator-lifecycle-manager-catalog 4.19.9 True False False 10m operator-lifecycle-manager-packageserver 4.19.9 True False False 10m service-ca storage 4.19.9 True False False 79s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 11m dns 4.19.9 False True True 11m DNS "default" is unavailable. image-registry False True True 11m Available: The deployment does not have available replicas... ingress False True True 11m The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 11m kube-controller-manager 4.19.9 True False False 11m kube-scheduler 4.19.9 True False False 11m kube-storage-version-migrator monitoring network 4.19.9 True True False 11m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning 4.19.9 True False False 97s openshift-apiserver 4.19.9 True False False 11m openshift-controller-manager 4.19.9 True False False 11m openshift-samples operator-lifecycle-manager 4.19.9 True False False 11m operator-lifecycle-manager-catalog 4.19.9 True False False 11m operator-lifecycle-manager-packageserver 4.19.9 True False False 11m service-ca storage 4.19.9 True False False 2m20s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 12m dns 4.19.9 False True True 12m DNS "default" is unavailable. image-registry False True True 12m Available: The deployment does not have available replicas... ingress False True True 12m The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 12m kube-controller-manager 4.19.9 True False False 12m kube-scheduler 4.19.9 True False False 12m kube-storage-version-migrator monitoring network 4.19.9 True True False 12m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning 4.19.9 True False False 2m37s openshift-apiserver 4.19.9 True False False 12m openshift-controller-manager 4.19.9 True False False 12m openshift-samples operator-lifecycle-manager 4.19.9 True False False 12m operator-lifecycle-manager-catalog 4.19.9 True False False 12m operator-lifecycle-manager-packageserver 4.19.9 True False False 12m service-ca storage 4.19.9 True False False 3m20s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 13m dns 4.19.9 False True True 13m DNS "default" is unavailable. image-registry False True True 13m Available: The deployment does not have available replicas... ingress False True True 13m The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights 4.19.9 True False False 38s kube-apiserver 4.19.9 True False False 13m kube-controller-manager 4.19.9 True False False 13m kube-scheduler 4.19.9 True False False 13m kube-storage-version-migrator 4.19.9 True False False 34s monitoring Unknown True Unknown 7s Rolling out the stack. network 4.19.9 True True False 13m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready node-tuning 4.19.9 True False False 3m37s openshift-apiserver 4.19.9 True False False 13m openshift-controller-manager 4.19.9 True False False 13m openshift-samples operator-lifecycle-manager 4.19.9 True False False 13m operator-lifecycle-manager-catalog 4.19.9 True False False 13m operator-lifecycle-manager-packageserver 4.19.9 True False False 13m service-ca 4.19.9 True False False 35s storage 4.19.9 True False False 4m20s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.19.9 True False False 33s csi-snapshot-controller 4.19.9 True False False 14m dns 4.19.9 True True False 37s DNS "default" reports Progressing=True: "Have 2 available DNS pods, want 3." image-registry 4.19.9 True False False 36s ingress 4.19.9 True False False 38s insights 4.19.9 True False False 98s kube-apiserver 4.19.9 True False False 14m kube-controller-manager 4.19.9 True False False 14m kube-scheduler 4.19.9 True False False 14m kube-storage-version-migrator 4.19.9 True False False 94s monitoring Unknown True Unknown 67s Rolling out the stack. network 4.19.9 True True False 14m DaemonSet "/openshift-multus/network-metrics-daemon" is not available (awaiting 2 nodes) node-tuning 4.19.9 True False False 4m37s openshift-apiserver 4.19.9 True False False 14m openshift-controller-manager 4.19.9 True False False 14m openshift-samples 4.19.9 True False False 32s operator-lifecycle-manager 4.19.9 True False False 14m operator-lifecycle-manager-catalog 4.19.9 True False False 14m operator-lifecycle-manager-packageserver 4.19.9 True False False 14m service-ca 4.19.9 True False False 95s storage 4.19.9 True False False 5m20s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.19.9 True False False 93s csi-snapshot-controller 4.19.9 True False False 15m dns 4.19.9 True False False 97s image-registry 4.19.9 True False False 96s ingress 4.19.9 True False False 98s insights 4.19.9 True False False 2m38s kube-apiserver 4.19.9 True False False 15m kube-controller-manager 4.19.9 True False False 15m kube-scheduler 4.19.9 True False False 15m kube-storage-version-migrator 4.19.9 True False False 2m34s monitoring Unknown True Unknown 2m7s Rolling out the stack. network 4.19.9 True False False 15m node-tuning 4.19.9 True False False 5m37s openshift-apiserver 4.19.9 True False False 15m openshift-controller-manager 4.19.9 True False False 15m openshift-samples 4.19.9 True False False 92s operator-lifecycle-manager 4.19.9 True False False 15m operator-lifecycle-manager-catalog 4.19.9 True False False 15m operator-lifecycle-manager-packageserver 4.19.9 True False False 15m service-ca 4.19.9 True False False 2m35s storage 4.19.9 True False False 6m20s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.19.9 True False False 2m34s csi-snapshot-controller 4.19.9 True False False 16m dns 4.19.9 True False False 2m38s image-registry 4.19.9 True False False 2m37s ingress 4.19.9 True False False 2m39s insights 4.19.9 True False False 3m39s kube-apiserver 4.19.9 True False False 16m kube-controller-manager 4.19.9 True False False 16m kube-scheduler 4.19.9 True False False 16m kube-storage-version-migrator 4.19.9 True False False 3m35s monitoring Unknown True Unknown 3m8s Rolling out the stack. network 4.19.9 True False False 16m node-tuning 4.19.9 True False False 6m38s openshift-apiserver 4.19.9 True False False 16m openshift-controller-manager 4.19.9 True False False 16m openshift-samples 4.19.9 True False False 2m33s operator-lifecycle-manager 4.19.9 True False False 16m operator-lifecycle-manager-catalog 4.19.9 True False False 16m operator-lifecycle-manager-packageserver 4.19.9 True False False 16m service-ca 4.19.9 True False False 3m36s storage 4.19.9 True False False 7m21s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.19.9 True False False 3m34s csi-snapshot-controller 4.19.9 True False False 17m dns 4.19.9 True False False 3m38s image-registry 4.19.9 True False False 3m37s ingress 4.19.9 True False False 3m39s insights 4.19.9 True False False 4m39s kube-apiserver 4.19.9 True False False 17m kube-controller-manager 4.19.9 True False False 17m kube-scheduler 4.19.9 True False False 17m kube-storage-version-migrator 4.19.9 True False False 4m35s monitoring 4.19.9 True False False 15s network 4.19.9 True False False 17m node-tuning 4.19.9 True False False 7m38s openshift-apiserver 4.19.9 True False False 17m openshift-controller-manager 4.19.9 True False False 17m openshift-samples 4.19.9 True False False 3m33s operator-lifecycle-manager 4.19.9 True False False 17m operator-lifecycle-manager-catalog 4.19.9 True False False 17m operator-lifecycle-manager-packageserver 4.19.9 True False False 17m service-ca 4.19.9 True False False 4m36s storage 4.19.9 True False False 8m21s Waiting for cluster to be reported as healthy... Trying again in 60s healthy cluster to be reported as healthy finished!