INFO: Log in to your Red Hat account... INFO: Configure AWS Credentials... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.59). WARN: It is recommended that you update to the latest version. INFO: Logged in as 'rhtap-shared' on 'https://api.openshift.com' INFO: Create ROSA with HCP cluster... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.59). WARN: It is recommended that you update to the latest version. INFO: Creating cluster 'kx-1238251b87' INFO: To view a list of clusters and their status, run 'rosa list clusters' INFO: Cluster 'kx-1238251b87' has been created. INFO: Once the cluster is installed you will need to add an Identity Provider before you can login into the cluster. See 'rosa create idp --help' for more information. Name: kx-1238251b87 Domain Prefix: kx-1238251b87 Display Name: kx-1238251b87 ID: 2nb8oi47j32hbpgq8p9c496paqpjhq0p External ID: 85856215-ed55-4cd0-b1ac-c41eba6799df Control Plane: ROSA Service Hosted OpenShift Version: 4.18.9 Channel Group: stable DNS: Not ready AWS Account: 381492310364 AWS Billing Account: 381492310364 API URL: Console URL: Region: us-east-1 Availability: - Control Plane: MultiAZ - Data Plane: MultiAZ Nodes: - Compute (desired): 3 - Compute (current): 0 Network: - Type: OVNKubernetes - Service CIDR: 172.30.0.0/16 - Machine CIDR: 10.0.0.0/16 - Pod CIDR: 10.128.0.0/14 - Host Prefix: /23 - Subnets: subnet-0208a6297964e4fe1, subnet-0c161c939f7025e15, subnet-023e5c7b3016ed194, subnet-02dbd8abbf884d77f, subnet-0360c2d20442c5ba5, subnet-0aad9c992e402a91a EC2 Metadata Http Tokens: optional Role (STS) ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Installer-Role Support Role ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Support-Role Instance IAM Roles: - Worker: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Worker-Role Operator IAM Roles: - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kms-provider - arn:aws:iam::381492310364:role/rhads-hcp-openshift-image-registry-installer-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-ingress-operator-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cluster-csi-drivers-ebs-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cloud-network-config-controller-cloud-creden - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kube-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-capa-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-control-plane-operator Managed Policies: Yes State: waiting (Waiting for user action) Private: No Delete Protection: Disabled Created: Dec 22 2025 05:42:37 UTC [DEPRECATED] User Workload Monitoring: Enabled Details Page: https://console.redhat.com/openshift/details/s/37Bh1SuDxi5aalXums4urbuz6FY OIDC Endpoint URL: https://oidc.op1.openshiftapps.com/2jtsga3i2etnl697l7bk5i1kmbm4a95j (Managed) Etcd Encryption: Disabled Audit Log Forwarding: Disabled External Authentication: Disabled Zero Egress: Disabled INFO: Preparing to create operator roles. INFO: Operator Roles already exists INFO: Preparing to create OIDC Provider. INFO: OIDC provider already exists INFO: To determine when your cluster is Ready, run 'rosa describe cluster -c kx-1238251b87'. INFO: To watch your cluster installation logs, run 'rosa logs install -c kx-1238251b87 --watch'. INFO: Track the progress of the cluster creation... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.59). WARN: It is recommended that you update to the latest version. W: Region flag will be removed from this command in future versions INFO: Cluster 'kx-1238251b87' is in waiting state waiting for installation to begin. Logs will show up within 5 minutes 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-1238251b87 Version 2025-12-22 05:48:58 +0000 UTC hostedclusters kx-1238251b87 ValidAWSIdentityProvider StatusUnknown 2025-12-22 05:48:59 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2025-12-22 05:48:59 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is supported by operator configuration 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Release image is valid 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Reconciliation active on resource 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is supported by operator configuration 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Release image is valid 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Reconciliation active on resource 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is supported by operator configuration 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Release image is valid 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Reconciliation active on resource 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is supported by operator configuration 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Release image is valid 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Reconciliation active on resource 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is supported by operator configuration 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Release image is valid 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Reconciliation active on resource 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is supported by operator configuration 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Release image is valid 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Reconciliation active on resource 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-1238251b87 Version 2025-12-22 05:48:58 +0000 UTC hostedclusters kx-1238251b87 ValidAWSIdentityProvider StatusUnknown 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Release image is valid 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the HCP 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is at expected version 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Reconciliation active on resource 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is supported by operator configuration 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 router load balancer is not provisioned; 6s since creation.; router load balancer is not provisioned; 6s since creation. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:50:33 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-12-22 05:50:43 +0000 UTC hostedclusters kx-1238251b87 Configuration passes validation 2025-12-22 05:50:45 +0000 UTC hostedclusters kx-1238251b87 Required platform credentials are found 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 router load balancer is not provisioned; 6s since creation.; router load balancer is not provisioned; 6s since creation. 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 lookup api.kx-1238251b87.5upw.p3.openshiftapps.com on 172.30.0.10:53: no such host 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 Configuration passes validation 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 capi-provider deployment has 1 unavailable replicas 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 AWS KMS is not configured 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 EtcdAvailable StatefulSetNotFound 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 Kube APIServer deployment not found 2025-12-22 05:50:50 +0000 UTC hostedclusters kx-1238251b87 OIDC configuration is valid 2025-12-22 05:50:50 +0000 UTC hostedclusters kx-1238251b87 Reconciliation completed successfully 2025-12-22 05:51:10 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:51:10 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:51:16 +0000 UTC hostedclusters kx-1238251b87 WebIdentityErr 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-1238251b87 Version 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Release image is valid 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 APIServer external route not admitted 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Reconciliation active on resource 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is at expected version 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment not found 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is supported by operator configuration 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:50:33 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-12-22 05:50:43 +0000 UTC hostedclusters kx-1238251b87 Configuration passes validation 2025-12-22 05:50:45 +0000 UTC hostedclusters kx-1238251b87 Required platform credentials are found 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 AWS KMS is not configured 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 [kube-controller-manager deployment has 1 unavailable replicas, kube-scheduler deployment has 1 unavailable replicas, openshift-apiserver deployment has 3 unavailable replicas] 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 lookup api.kx-1238251b87.5upw.p3.openshiftapps.com on 172.30.0.10:53: no such host 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 Configuration passes validation 2025-12-22 05:50:50 +0000 UTC hostedclusters kx-1238251b87 OIDC configuration is valid 2025-12-22 05:50:50 +0000 UTC hostedclusters kx-1238251b87 Reconciliation completed successfully 2025-12-22 05:51:10 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:51:10 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:51:39 +0000 UTC hostedclusters kx-1238251b87 EtcdAvailable QuorumAvailable 2025-12-22 05:52:04 +0000 UTC hostedclusters kx-1238251b87 Kube APIServer deployment is available 2025-12-22 05:52:17 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:52:38 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:52:43 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment is available 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 ClusterVersionSucceeding FromClusterVersion 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 Payload loaded version="4.18.9" image="quay.io/openshift-release-dev/ocp-release@sha256:dafd6d1fe6008bf1a3e5baea3420aa0344412bf3167e1e92bec5c92098dc6464" architecture="Multi" 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 ClusterVersionAvailable FromClusterVersion 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 Working towards 4.18.9: 280 of 613 done (45% complete) 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-1238251b87 Version 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is at expected version 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Reconciliation active on resource 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Get "https://ae156f0aa8e17426cb17f2be46960772-9e419ff64ca618ad.elb.us-east-1.amazonaws.com:443/healthz": dial tcp: lookup ae156f0aa8e17426cb17f2be46960772-9e419ff64ca618ad.elb.us-east-1.amazonaws.com on 172.30.0.10:53: no such host 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Release image is valid 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is supported by operator configuration 2025-12-22 05:50:33 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-12-22 05:50:43 +0000 UTC hostedclusters kx-1238251b87 Configuration passes validation 2025-12-22 05:50:45 +0000 UTC hostedclusters kx-1238251b87 Required platform credentials are found 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 Configuration passes validation 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 [catalog-operator deployment has 1 unavailable replicas, cloud-credential-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, oauth-openshift deployment has 1 unavailable replicas, router deployment has 1 unavailable replicas] 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 AWS KMS is not configured 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 lookup api.kx-1238251b87.5upw.p3.openshiftapps.com on 172.30.0.10:53: no such host 2025-12-22 05:50:50 +0000 UTC hostedclusters kx-1238251b87 OIDC configuration is valid 2025-12-22 05:50:50 +0000 UTC hostedclusters kx-1238251b87 Reconciliation completed successfully 2025-12-22 05:51:10 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:51:10 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:51:39 +0000 UTC hostedclusters kx-1238251b87 EtcdAvailable QuorumAvailable 2025-12-22 05:52:04 +0000 UTC hostedclusters kx-1238251b87 Kube APIServer deployment is available 2025-12-22 05:52:17 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:52:38 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:52:43 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment is available 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 Payload loaded version="4.18.9" image="quay.io/openshift-release-dev/ocp-release@sha256:dafd6d1fe6008bf1a3e5baea3420aa0344412bf3167e1e92bec5c92098dc6464" architecture="Multi" 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 ClusterVersionAvailable FromClusterVersion 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 Unable to apply 4.18.9: an unknown error has occurred: MultipleErrors 2025-12-22 05:53:29 +0000 UTC hostedclusters kx-1238251b87 Multiple errors are preventing progress: * Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, network, node-tuning, openshift-samples, service-ca are not available * Could not update imagestream "openshift/driver-toolkit" (440 of 613): resource may have been deleted * Could not update operatorgroup "openshift-monitoring/openshift-cluster-monitoring" (554 of 613): resource may have been deleted * Could not update role "openshift-authentication/prometheus-k8s" (541 of 613): resource may have been deleted * Could not update role "openshift-console-operator/prometheus-k8s" (571 of 613): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (575 of 613): resource may have been deleted * Could not update role "openshift-ingress-operator/prometheus-k8s" (582 of 613): resource may have been deleted * Could not update role "openshift-kube-apiserver-operator/prometheus-k8s" (586 of 613): resource may have been deleted 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-1238251b87 Version 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is at expected version 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Reconciliation active on resource 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 Release image is valid 2025-12-22 05:49:03 +0000 UTC hostedclusters kx-1238251b87 HostedCluster is supported by operator configuration 2025-12-22 05:50:33 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-12-22 05:50:43 +0000 UTC hostedclusters kx-1238251b87 Configuration passes validation 2025-12-22 05:50:45 +0000 UTC hostedclusters kx-1238251b87 Required platform credentials are found 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 Configuration passes validation 2025-12-22 05:50:47 +0000 UTC hostedclusters kx-1238251b87 AWS KMS is not configured 2025-12-22 05:50:50 +0000 UTC hostedclusters kx-1238251b87 OIDC configuration is valid 2025-12-22 05:51:10 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:51:10 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:51:39 +0000 UTC hostedclusters kx-1238251b87 EtcdAvailable QuorumAvailable 2025-12-22 05:52:04 +0000 UTC hostedclusters kx-1238251b87 Kube APIServer deployment is available 2025-12-22 05:52:17 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:52:38 +0000 UTC hostedclusters kx-1238251b87 All is well 2025-12-22 05:52:43 +0000 UTC hostedclusters kx-1238251b87 Ignition server deployment is available 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 Payload loaded version="4.18.9" image="quay.io/openshift-release-dev/ocp-release@sha256:dafd6d1fe6008bf1a3e5baea3420aa0344412bf3167e1e92bec5c92098dc6464" architecture="Multi" 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 ClusterVersionAvailable FromClusterVersion 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 Unable to apply 4.18.9: some cluster operators are not available 2025-12-22 05:52:58 +0000 UTC hostedclusters kx-1238251b87 Condition not found in the CVO. 2025-12-22 05:53:29 +0000 UTC hostedclusters kx-1238251b87 Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available 2025-12-22 05:53:49 +0000 UTC hostedclusters kx-1238251b87 The hosted control plane is available INFO: Cluster 'kx-1238251b87' is now ready INFO: ROSA with HCP cluster is ready, create a cluster admin account for accessing the cluster WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.59). WARN: It is recommended that you update to the latest version. INFO: Storing login command... INFO: Check if it's able to login to OCP cluster... Retried 1 times... INFO: Check if apiserver is ready... Waiting for cluster operators to be accessible for 2m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 3m29s dns 4.18.9 False False True 3m30s DNS "default" is unavailable. image-registry False True True 2m31s Available: The deployment does not have available replicas... ingress False True True 3m7s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 3m22s kube-controller-manager 4.18.9 True False False 3m22s kube-scheduler 4.18.9 True False False 3m22s kube-storage-version-migrator monitoring network 4.18.9 True True False 2m59s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 3m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 3m22s openshift-controller-manager 4.18.9 True False False 3m22s openshift-samples operator-lifecycle-manager 4.18.9 True False False 3m24s operator-lifecycle-manager-catalog 4.18.9 True False False 3m20s operator-lifecycle-manager-packageserver 4.18.9 True False False 3m22s service-ca storage 4.18.9 False False False 3m22s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service cluster operators to be accessible finished! [INFO] Cluster operators are accessible. Waiting for cluster to be reported as healthy for 60m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 3m29s dns 4.18.9 False False True 3m30s DNS "default" is unavailable. image-registry False True True 2m31s Available: The deployment does not have available replicas... ingress False True True 3m7s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 3m22s kube-controller-manager 4.18.9 True False False 3m22s kube-scheduler 4.18.9 True False False 3m22s kube-storage-version-migrator monitoring network 4.18.9 True True False 2m59s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 3m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 3m22s openshift-controller-manager 4.18.9 True False False 3m22s openshift-samples operator-lifecycle-manager 4.18.9 True False False 3m24s operator-lifecycle-manager-catalog 4.18.9 True False False 3m20s operator-lifecycle-manager-packageserver 4.18.9 True False False 3m22s service-ca storage 4.18.9 False False False 3m22s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 4m29s dns 4.18.9 False False True 4m30s DNS "default" is unavailable. image-registry False True True 3m31s Available: The deployment does not have available replicas... ingress False True True 4m7s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 4m22s kube-controller-manager 4.18.9 True False False 4m22s kube-scheduler 4.18.9 True False False 4m22s kube-storage-version-migrator monitoring network 4.18.9 True True False 3m59s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 4m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 4m22s openshift-controller-manager 4.18.9 True False False 4m22s openshift-samples operator-lifecycle-manager 4.18.9 True False False 4m24s operator-lifecycle-manager-catalog 4.18.9 True False False 4m20s operator-lifecycle-manager-packageserver 4.18.9 True False False 4m22s service-ca storage 4.18.9 False False False 4m22s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 5m29s dns 4.18.9 False False True 5m30s DNS "default" is unavailable. image-registry False True True 4m31s Available: The deployment does not have available replicas... ingress False True True 5m7s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 5m22s kube-controller-manager 4.18.9 True False False 5m22s kube-scheduler 4.18.9 True False False 5m22s kube-storage-version-migrator monitoring network 4.18.9 True True False 4m59s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 5m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 5m22s openshift-controller-manager 4.18.9 True False False 5m22s openshift-samples operator-lifecycle-manager 4.18.9 True False False 5m24s operator-lifecycle-manager-catalog 4.18.9 True False False 5m20s operator-lifecycle-manager-packageserver 4.18.9 True False False 5m22s service-ca storage 4.18.9 False False False 5m22s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 6m29s dns 4.18.9 False False True 6m30s DNS "default" is unavailable. image-registry False True True 5m31s Available: The deployment does not have available replicas... ingress False True True 6m7s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 6m22s kube-controller-manager 4.18.9 True False False 6m22s kube-scheduler 4.18.9 True False False 6m22s kube-storage-version-migrator monitoring network 4.18.9 True True False 5m59s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 6m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 6m22s openshift-controller-manager 4.18.9 True False False 6m22s openshift-samples operator-lifecycle-manager 4.18.9 True False False 6m24s operator-lifecycle-manager-catalog 4.18.9 True False False 6m20s operator-lifecycle-manager-packageserver 4.18.9 True False False 6m22s service-ca storage 4.18.9 False False False 6m22s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 7m30s dns 4.18.9 False False True 7m31s DNS "default" is unavailable. image-registry False True True 6m32s Available: The deployment does not have available replicas... ingress False True True 7m8s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 7m23s kube-controller-manager 4.18.9 True False False 7m23s kube-scheduler 4.18.9 True False False 7m23s kube-storage-version-migrator monitoring network 4.18.9 True True False 7m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 7m17s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 7m23s openshift-controller-manager 4.18.9 True False False 7m23s openshift-samples operator-lifecycle-manager 4.18.9 True False False 7m25s operator-lifecycle-manager-catalog 4.18.9 True False False 7m21s operator-lifecycle-manager-packageserver 4.18.9 True False False 7m23s service-ca storage 4.18.9 False False False 7m23s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 8m30s dns 4.18.9 False False True 8m31s DNS "default" is unavailable. image-registry False True True 7m32s Available: The deployment does not have available replicas... ingress False True True 8m8s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 8m23s kube-controller-manager 4.18.9 True False False 8m23s kube-scheduler 4.18.9 True False False 8m23s kube-storage-version-migrator monitoring network 4.18.9 True True False 8m DaemonSet "/openshift-multus/multus-additional-cni-plugins" is not available (awaiting 3 nodes)... node-tuning 4.18.9 True False False 20s openshift-apiserver 4.18.9 True False False 8m23s openshift-controller-manager 4.18.9 True False False 8m23s openshift-samples operator-lifecycle-manager 4.18.9 True False False 8m25s operator-lifecycle-manager-catalog 4.18.9 True False False 8m21s operator-lifecycle-manager-packageserver 4.18.9 True False False 8m23s service-ca storage 4.18.9 True False False 16s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 Unknown False False 9s csi-snapshot-controller 4.18.9 True False False 9m30s dns 4.18.9 False True True 9m31s DNS "default" is unavailable. image-registry False True True 8m32s Available: The deployment does not have available replicas... ingress False True True 9m8s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights 4.18.9 True False False 25s kube-apiserver 4.18.9 True False False 9m23s kube-controller-manager 4.18.9 True False False 9m23s kube-scheduler 4.18.9 True False False 9m23s kube-storage-version-migrator 4.18.9 True False False 23s monitoring Unknown True Unknown 13s Rolling out the stack. network 4.18.9 True True False 9m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning 4.18.9 True False False 80s openshift-apiserver 4.18.9 True False False 9m23s openshift-controller-manager 4.18.9 True False False 9m23s openshift-samples operator-lifecycle-manager 4.18.9 True False False 9m25s operator-lifecycle-manager-catalog 4.18.9 True False False 9m21s operator-lifecycle-manager-packageserver 4.18.9 True False False 9m23s service-ca 4.18.9 True False False 24s storage 4.18.9 True False False 76s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 48s csi-snapshot-controller 4.18.9 True False False 10m dns 4.18.9 True False False 45s image-registry 4.18.9 True False False 44s ingress 4.18.9 True False False 27s insights 4.18.9 True False False 85s kube-apiserver 4.18.9 True False False 10m kube-controller-manager 4.18.9 True False False 10m kube-scheduler 4.18.9 True False False 10m kube-storage-version-migrator 4.18.9 True False False 83s monitoring Unknown True Unknown 73s Rolling out the stack. network 4.18.9 True False False 10m node-tuning 4.18.9 True False False 2m20s openshift-apiserver 4.18.9 True False False 10m openshift-controller-manager 4.18.9 True False False 10m openshift-samples 4.18.9 True False False 36s operator-lifecycle-manager 4.18.9 True False False 10m operator-lifecycle-manager-catalog 4.18.9 True False False 10m operator-lifecycle-manager-packageserver 4.18.9 True False False 10m service-ca 4.18.9 True False False 84s storage 4.18.9 True False False 2m16s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 109s csi-snapshot-controller 4.18.9 True False False 11m dns 4.18.9 True False False 106s image-registry 4.18.9 True False False 105s ingress 4.18.9 True False False 88s insights 4.18.9 True False False 2m26s kube-apiserver 4.18.9 True False False 11m kube-controller-manager 4.18.9 True False False 11m kube-scheduler 4.18.9 True False False 11m kube-storage-version-migrator 4.18.9 True False False 2m24s monitoring Unknown True Unknown 2m14s Rolling out the stack. network 4.18.9 True False False 11m node-tuning 4.18.9 True False False 3m21s openshift-apiserver 4.18.9 True False False 11m openshift-controller-manager 4.18.9 True False False 11m openshift-samples 4.18.9 True False False 97s operator-lifecycle-manager 4.18.9 True False False 11m operator-lifecycle-manager-catalog 4.18.9 True False False 11m operator-lifecycle-manager-packageserver 4.18.9 True False False 11m service-ca 4.18.9 True False False 2m25s storage 4.18.9 True False False 3m17s Waiting for cluster to be reported as healthy... Trying again in 60s healthy cluster to be reported as healthy finished!