INFO: Log in to your Red Hat account... INFO: Configure AWS Credentials... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.57). WARN: It is recommended that you update to the latest version. INFO: Logged in as 'rhtap-shared' on 'https://api.openshift.com' INFO: Create ROSA with HCP cluster... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.57). WARN: It is recommended that you update to the latest version. INFO: Creating cluster 'kx-de448fce54' INFO: To view a list of clusters and their status, run 'rosa list clusters' INFO: Cluster 'kx-de448fce54' has been created. INFO: Once the cluster is installed you will need to add an Identity Provider before you can login into the cluster. See 'rosa create idp --help' for more information. Name: kx-de448fce54 Domain Prefix: kx-de448fce54 Display Name: kx-de448fce54 ID: 2m96s4omtlroqovegt23l7lutvvo8odb External ID: b0c8ae69-5061-4701-a728-1b467dc11e3e Control Plane: ROSA Service Hosted OpenShift Version: 4.18.9 Channel Group: stable DNS: Not ready AWS Account: 381492310364 AWS Billing Account: 381492310364 API URL: Console URL: Region: us-east-1 Availability: - Control Plane: MultiAZ - Data Plane: MultiAZ Nodes: - Compute (desired): 3 - Compute (current): 0 Network: - Type: OVNKubernetes - Service CIDR: 172.30.0.0/16 - Machine CIDR: 10.0.0.0/16 - Pod CIDR: 10.128.0.0/14 - Host Prefix: /23 - Subnets: subnet-0208a6297964e4fe1, subnet-0c161c939f7025e15, subnet-023e5c7b3016ed194, subnet-02dbd8abbf884d77f, subnet-0360c2d20442c5ba5, subnet-0aad9c992e402a91a EC2 Metadata Http Tokens: optional Role (STS) ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Installer-Role Support Role ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Support-Role Instance IAM Roles: - Worker: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Worker-Role Operator IAM Roles: - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kms-provider - arn:aws:iam::381492310364:role/rhads-hcp-openshift-image-registry-installer-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-ingress-operator-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cluster-csi-drivers-ebs-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cloud-network-config-controller-cloud-creden - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kube-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-capa-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-control-plane-operator Managed Policies: Yes State: waiting (Waiting for user action) Private: No Delete Protection: Disabled Created: Oct 31 2025 13:39:43 UTC [DEPRECATED] User Workload Monitoring: Enabled Details Page: https://console.redhat.com/openshift/details/s/34pkctp2IbkByA8kJhtKzJpNExY OIDC Endpoint URL: https://oidc.op1.openshiftapps.com/2jtsga3i2etnl697l7bk5i1kmbm4a95j (Managed) Etcd Encryption: Disabled Audit Log Forwarding: Disabled External Authentication: Disabled Zero Egress: Disabled INFO: Preparing to create operator roles. INFO: Operator Roles already exists INFO: Preparing to create OIDC Provider. INFO: OIDC provider already exists INFO: To determine when your cluster is Ready, run 'rosa describe cluster -c kx-de448fce54'. INFO: To watch your cluster installation logs, run 'rosa logs install -c kx-de448fce54 --watch'. INFO: Track the progress of the cluster creation... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.57). WARN: It is recommended that you update to the latest version. W: Region flag will be removed from this command in future versions INFO: Cluster 'kx-de448fce54' is in waiting state waiting for installation to begin. Logs will show up within 5 minutes 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-de448fce54 Version 2025-10-31 13:43:52 +0000 UTC hostedclusters kx-de448fce54 ValidAWSIdentityProvider StatusUnknown 2025-10-31 13:43:54 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2025-10-31 13:43:54 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Ignition server deployment not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is supported by operator configuration 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Release image is valid 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Reconciliation active on resource 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Ignition server deployment not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is supported by operator configuration 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Release image is valid 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Reconciliation active on resource 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Ignition server deployment not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is supported by operator configuration 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Release image is valid 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Reconciliation active on resource 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Ignition server deployment not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is supported by operator configuration 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Release image is valid 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Reconciliation active on resource 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Ignition server deployment not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is supported by operator configuration 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Release image is valid 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Reconciliation active on resource 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Ignition server deployment not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is supported by operator configuration 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Release image is valid 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Reconciliation active on resource 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-de448fce54 Version 2025-10-31 13:43:52 +0000 UTC hostedclusters kx-de448fce54 ValidAWSIdentityProvider StatusUnknown 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Release image is valid 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the HCP 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is at expected version 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Reconciliation active on resource 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Ignition server deployment not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is supported by operator configuration 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 router load balancer is not provisioned; 9s since creation. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:45:17 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-10-31 13:45:19 +0000 UTC hostedclusters kx-de448fce54 Configuration passes validation 2025-10-31 13:45:20 +0000 UTC hostedclusters kx-de448fce54 Required platform credentials are found 2025-10-31 13:45:22 +0000 UTC hostedclusters kx-de448fce54 OIDC configuration is valid 2025-10-31 13:45:22 +0000 UTC hostedclusters kx-de448fce54 Reconciliation completed successfully 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 router load balancer is not provisioned; 9s since creation. 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 lookup api.kx-de448fce54.7ag9.p3.openshiftapps.com on 172.30.0.10:53: no such host 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 Configuration passes validation 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 capi-provider deployment has 1 unavailable replicas 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 AWS KMS is not configured 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 EtcdAvailable StatefulSetNotFound 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 Kube APIServer deployment not found 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-de448fce54 Version 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Release image is valid 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Waiting for Kube APIServer deployment to become available 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is at expected version 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is supported by operator configuration 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Ignition server deployment not found 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Reconciliation active on resource 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:45:17 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-10-31 13:45:19 +0000 UTC hostedclusters kx-de448fce54 Configuration passes validation 2025-10-31 13:45:20 +0000 UTC hostedclusters kx-de448fce54 Required platform credentials are found 2025-10-31 13:45:22 +0000 UTC hostedclusters kx-de448fce54 OIDC configuration is valid 2025-10-31 13:45:22 +0000 UTC hostedclusters kx-de448fce54 Reconciliation completed successfully 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 AWS KMS is not configured 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 [capi-provider deployment has 2 unavailable replicas, kube-apiserver deployment has 2 unavailable replicas] 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 lookup api.kx-de448fce54.7ag9.p3.openshiftapps.com on 172.30.0.10:53: no such host 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 Configuration passes validation 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 Waiting for Kube APIServer deployment to become available 2025-10-31 13:45:51 +0000 UTC hostedclusters kx-de448fce54 All is well 2025-10-31 13:45:51 +0000 UTC hostedclusters kx-de448fce54 All is well 2025-10-31 13:45:56 +0000 UTC hostedclusters kx-de448fce54 WebIdentityErr 2025-10-31 13:46:25 +0000 UTC hostedclusters kx-de448fce54 EtcdAvailable QuorumAvailable 2025-10-31 13:47:03 +0000 UTC hostedclusters kx-de448fce54 Kube APIServer deployment is available 2025-10-31 13:47:27 +0000 UTC hostedclusters kx-de448fce54 All is well 2025-10-31 13:47:28 +0000 UTC hostedclusters kx-de448fce54 Ignition server deployment is available 2025-10-31 13:47:29 +0000 UTC hostedclusters kx-de448fce54 All is well 2025-10-31 13:47:47 +0000 UTC hostedclusters kx-de448fce54 ClusterVersionAvailable FromClusterVersion 2025-10-31 13:47:47 +0000 UTC hostedclusters kx-de448fce54 ClusterVersionSucceeding FromClusterVersion 2025-10-31 13:47:47 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:47:47 +0000 UTC hostedclusters kx-de448fce54 Working towards 4.18.9: 466 of 613 done (76% complete) 2025-10-31 13:47:47 +0000 UTC hostedclusters kx-de448fce54 Payload loaded version="4.18.9" image="quay.io/openshift-release-dev/ocp-release@sha256:dafd6d1fe6008bf1a3e5baea3420aa0344412bf3167e1e92bec5c92098dc6464" architecture="Multi" 2025-10-31 13:47:56 +0000 UTC hostedclusters kx-de448fce54 lookup api.kx-de448fce54.7ag9.p3.openshiftapps.com on 172.30.0.10:53: no such host 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-de448fce54 Version 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is at expected version 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Reconciliation active on resource 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 Release image is valid 2025-10-31 13:43:56 +0000 UTC hostedclusters kx-de448fce54 HostedCluster is supported by operator configuration 2025-10-31 13:45:17 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-10-31 13:45:19 +0000 UTC hostedclusters kx-de448fce54 Configuration passes validation 2025-10-31 13:45:20 +0000 UTC hostedclusters kx-de448fce54 Required platform credentials are found 2025-10-31 13:45:22 +0000 UTC hostedclusters kx-de448fce54 Reconciliation completed successfully 2025-10-31 13:45:22 +0000 UTC hostedclusters kx-de448fce54 OIDC configuration is valid 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 Configuration passes validation 2025-10-31 13:45:28 +0000 UTC hostedclusters kx-de448fce54 AWS KMS is not configured 2025-10-31 13:45:51 +0000 UTC hostedclusters kx-de448fce54 All is well 2025-10-31 13:45:51 +0000 UTC hostedclusters kx-de448fce54 All is well 2025-10-31 13:46:25 +0000 UTC hostedclusters kx-de448fce54 EtcdAvailable QuorumAvailable 2025-10-31 13:47:03 +0000 UTC hostedclusters kx-de448fce54 Kube APIServer deployment is available 2025-10-31 13:47:27 +0000 UTC hostedclusters kx-de448fce54 All is well 2025-10-31 13:47:28 +0000 UTC hostedclusters kx-de448fce54 Ignition server deployment is available 2025-10-31 13:47:29 +0000 UTC hostedclusters kx-de448fce54 All is well 2025-10-31 13:47:47 +0000 UTC hostedclusters kx-de448fce54 Unable to apply 4.18.9: some cluster operators are not available 2025-10-31 13:47:47 +0000 UTC hostedclusters kx-de448fce54 Condition not found in the CVO. 2025-10-31 13:47:47 +0000 UTC hostedclusters kx-de448fce54 Payload loaded version="4.18.9" image="quay.io/openshift-release-dev/ocp-release@sha256:dafd6d1fe6008bf1a3e5baea3420aa0344412bf3167e1e92bec5c92098dc6464" architecture="Multi" 2025-10-31 13:47:47 +0000 UTC hostedclusters kx-de448fce54 ClusterVersionAvailable FromClusterVersion 2025-10-31 13:48:30 +0000 UTC hostedclusters kx-de448fce54 Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available 2025-10-31 13:48:31 +0000 UTC hostedclusters kx-de448fce54 The hosted cluster is not degraded 2025-10-31 13:48:36 +0000 UTC hostedclusters kx-de448fce54 The hosted control plane is available INFO: Cluster 'kx-de448fce54' is now ready INFO: ROSA with HCP cluster is ready, create a cluster admin account for accessing the cluster WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.57). WARN: It is recommended that you update to the latest version. INFO: Storing login command... INFO: Check if it's able to login to OCP cluster... Retried 1 times... Retried 2 times... INFO: Check if apiserver is ready... Waiting for cluster operators to be accessible for 2m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 4m39s dns 4.18.9 False False True 4m41s DNS "default" is unavailable. image-registry False True True 4m27s Available: The deployment does not have available replicas... ingress False True True 4m14s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 4m33s kube-controller-manager 4.18.9 True False False 4m33s kube-scheduler 4.18.9 True False False 4m33s kube-storage-version-migrator monitoring network 4.18.9 True True False 4m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 4m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 4m33s openshift-controller-manager 4.18.9 True False False 4m33s openshift-samples operator-lifecycle-manager 4.18.9 True False False 4m36s operator-lifecycle-manager-catalog 4.18.9 True False False 4m30s operator-lifecycle-manager-packageserver 4.18.9 True False False 4m33s service-ca storage 4.18.9 False False False 4m33s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service cluster operators to be accessible finished! [INFO] Cluster operators are accessible. Waiting for cluster to be reported as healthy for 60m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 4m39s dns 4.18.9 False False True 4m41s DNS "default" is unavailable. image-registry False True True 4m27s Available: The deployment does not have available replicas... ingress False True True 4m14s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 4m33s kube-controller-manager 4.18.9 True False False 4m33s kube-scheduler 4.18.9 True False False 4m33s kube-storage-version-migrator monitoring network 4.18.9 True True False 4m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 4m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 4m33s openshift-controller-manager 4.18.9 True False False 4m33s openshift-samples operator-lifecycle-manager 4.18.9 True False False 4m36s operator-lifecycle-manager-catalog 4.18.9 True False False 4m30s operator-lifecycle-manager-packageserver 4.18.9 True False False 4m33s service-ca storage 4.18.9 False False False 4m33s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s Unable to connect to the server: dial tcp: lookup api.kx-de448fce54.7ag9.p3.openshiftapps.com on 172.30.0.10:53: no such host Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 6m40s dns 4.18.9 False False True 6m42s DNS "default" is unavailable. image-registry False True True 6m28s Available: The deployment does not have available replicas... ingress False True True 6m15s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 6m34s kube-controller-manager 4.18.9 True False False 6m34s kube-scheduler 4.18.9 True False False 6m34s kube-storage-version-migrator monitoring network 4.18.9 True True False 6m1s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 6m17s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 6m34s openshift-controller-manager 4.18.9 True False False 6m34s openshift-samples operator-lifecycle-manager 4.18.9 True False False 6m37s operator-lifecycle-manager-catalog 4.18.9 True False False 6m31s operator-lifecycle-manager-packageserver 4.18.9 True False False 6m34s service-ca storage 4.18.9 False False False 6m34s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 7m40s dns 4.18.9 False False True 7m42s DNS "default" is unavailable. image-registry False True True 7m28s Available: The deployment does not have available replicas... ingress False True True 7m15s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 7m34s kube-controller-manager 4.18.9 True False False 7m34s kube-scheduler 4.18.9 True False False 7m34s kube-storage-version-migrator monitoring network 4.18.9 True True False 7m1s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 7m17s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 7m34s openshift-controller-manager 4.18.9 True False False 7m34s openshift-samples operator-lifecycle-manager 4.18.9 True False False 7m37s operator-lifecycle-manager-catalog 4.18.9 True False False 7m31s operator-lifecycle-manager-packageserver 4.18.9 True False False 7m34s service-ca storage 4.18.9 False False False 7m34s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 8m40s dns 4.18.9 False True True 8m42s DNS "default" is unavailable. image-registry False True True 8m28s Available: The deployment does not have available replicas... ingress False True True 8m15s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.18.9 True False False 8m34s kube-controller-manager 4.18.9 True False False 8m34s kube-scheduler 4.18.9 True False False 8m34s kube-storage-version-migrator monitoring network 4.18.9 True True False 8m1s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 8m17s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.18.9 True False False 8m34s openshift-controller-manager 4.18.9 True False False 8m34s openshift-samples operator-lifecycle-manager 4.18.9 True False False 8m37s operator-lifecycle-manager-catalog 4.18.9 True False False 8m31s operator-lifecycle-manager-packageserver 4.18.9 True False False 8m34s service-ca storage 4.18.9 False True False 8m34s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.18.9 True False False 9m40s dns 4.18.9 False False True 9m42s DNS "default" is unavailable. image-registry False True True 9m28s Available: The deployment does not have available replicas... ingress False True True 9m15s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights 4.18.9 True False False 3s kube-apiserver 4.18.9 True False False 9m34s kube-controller-manager 4.18.9 True False False 9m34s kube-scheduler 4.18.9 True False False 9m34s kube-storage-version-migrator 4.18.9 False True False 2s KubeStorageVersionMigratorAvailable: Waiting for Deployment monitoring network 4.18.9 True True False 9m1s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning 4.18.9 True False False 56s openshift-apiserver 4.18.9 True False False 9m34s openshift-controller-manager 4.18.9 True False False 9m34s openshift-samples operator-lifecycle-manager 4.18.9 True False False 9m37s operator-lifecycle-manager-catalog 4.18.9 True False False 9m31s operator-lifecycle-manager-packageserver 4.18.9 True False False 9m34s service-ca True True False 0s Progressing: ... storage 4.18.9 True False False 44s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 6s csi-snapshot-controller 4.18.9 True False False 10m dns 4.18.9 True True False 8s DNS "default" reports Progressing=True: "Have 2 available DNS pods, want 3." image-registry 4.18.9 True False False 6s ingress False True True 10m The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights 4.18.9 True False False 64s kube-apiserver 4.18.9 True False False 10m kube-controller-manager 4.18.9 True False False 10m kube-scheduler 4.18.9 True False False 10m kube-storage-version-migrator 4.18.9 True False False 60s monitoring Unknown True Unknown 33s Rolling out the stack. network 4.18.9 True True False 10m DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready node-tuning 4.18.9 True False False 117s openshift-apiserver 4.18.9 True False False 10m openshift-controller-manager 4.18.9 True False False 10m openshift-samples False False False 7s SampleUpsertsPending operator-lifecycle-manager 4.18.9 True False False 10m operator-lifecycle-manager-catalog 4.18.9 True False False 10m operator-lifecycle-manager-packageserver 4.18.9 True False False 10m service-ca 4.18.9 True False False 61s storage 4.18.9 True False False 105s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 66s csi-snapshot-controller 4.18.9 True False False 11m dns 4.18.9 True False False 68s image-registry 4.18.9 True False False 66s ingress 4.18.9 True False False 57s insights 4.18.9 True False False 2m4s kube-apiserver 4.18.9 True False False 11m kube-controller-manager 4.18.9 True False False 11m kube-scheduler 4.18.9 True False False 11m kube-storage-version-migrator 4.18.9 True False False 2m monitoring Unknown True Unknown 93s Rolling out the stack. network 4.18.9 True False False 11m node-tuning 4.18.9 True False False 2m57s openshift-apiserver 4.18.9 True False False 11m openshift-controller-manager 4.18.9 True False False 11m openshift-samples 4.18.9 True False False 56s operator-lifecycle-manager 4.18.9 True False False 11m operator-lifecycle-manager-catalog 4.18.9 True False False 11m operator-lifecycle-manager-packageserver 4.18.9 True False False 11m service-ca 4.18.9 True False False 2m1s storage 4.18.9 True False False 2m45s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 2m6s csi-snapshot-controller 4.18.9 True False False 12m dns 4.18.9 True False False 2m8s image-registry 4.18.9 True False False 2m6s ingress 4.18.9 True False False 117s insights 4.18.9 True False False 3m4s kube-apiserver 4.18.9 True False False 12m kube-controller-manager 4.18.9 True False False 12m kube-scheduler 4.18.9 True False False 12m kube-storage-version-migrator 4.18.9 True False False 3m monitoring 4.18.9 True False False 9s network 4.18.9 True False False 12m node-tuning 4.18.9 True False False 3m57s openshift-apiserver 4.18.9 True False False 12m openshift-controller-manager 4.18.9 True False False 12m openshift-samples 4.18.9 True False False 116s operator-lifecycle-manager 4.18.9 True False False 12m operator-lifecycle-manager-catalog 4.18.9 True False False 12m operator-lifecycle-manager-packageserver 4.18.9 True False False 12m service-ca 4.18.9 True False False 3m1s storage 4.18.9 True False False 3m45s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 3m6s csi-snapshot-controller 4.18.9 True False False 13m dns 4.18.9 True False False 3m8s image-registry 4.18.9 True False False 3m6s ingress 4.18.9 True False False 2m57s insights 4.18.9 True False False 4m4s kube-apiserver 4.18.9 True False False 13m kube-controller-manager 4.18.9 True False False 13m kube-scheduler 4.18.9 True False False 13m kube-storage-version-migrator 4.18.9 True False False 4m monitoring 4.18.9 True False False 69s network 4.18.9 True False False 13m node-tuning 4.18.9 True False False 4m57s openshift-apiserver 4.18.9 True False False 13m openshift-controller-manager 4.18.9 True False False 13m openshift-samples 4.18.9 True False False 2m56s operator-lifecycle-manager 4.18.9 True False False 13m operator-lifecycle-manager-catalog 4.18.9 True False False 13m operator-lifecycle-manager-packageserver 4.18.9 True False False 13m service-ca 4.18.9 True False False 4m1s storage 4.18.9 True False False 4m45s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 4m7s csi-snapshot-controller 4.18.9 True False False 14m dns 4.18.9 True False False 4m9s image-registry 4.18.9 True False False 4m7s ingress 4.18.9 True False False 3m58s insights 4.18.9 True False False 5m5s kube-apiserver 4.18.9 True False False 14m kube-controller-manager 4.18.9 True False False 14m kube-scheduler 4.18.9 True False False 14m kube-storage-version-migrator 4.18.9 True False False 5m1s monitoring 4.18.9 True False False 2m10s network 4.18.9 True False False 14m node-tuning 4.18.9 True False False 5m58s openshift-apiserver 4.18.9 True False False 14m openshift-controller-manager 4.18.9 True False False 14m openshift-samples 4.18.9 True False False 3m57s operator-lifecycle-manager 4.18.9 True False False 14m operator-lifecycle-manager-catalog 4.18.9 True False False 14m operator-lifecycle-manager-packageserver 4.18.9 True False False 14m service-ca 4.18.9 True False False 5m2s storage 4.18.9 True False False 5m46s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 5m7s csi-snapshot-controller 4.18.9 True False False 15m dns 4.18.9 True False False 5m9s image-registry 4.18.9 True False False 5m7s ingress 4.18.9 True False False 4m58s insights 4.18.9 True False False 6m5s kube-apiserver 4.18.9 True False False 15m kube-controller-manager 4.18.9 True False False 15m kube-scheduler 4.18.9 True False False 15m kube-storage-version-migrator 4.18.9 True False False 6m1s monitoring 4.18.9 True False False 3m10s network 4.18.9 True False False 15m node-tuning 4.18.9 True False False 6m58s openshift-apiserver 4.18.9 True False False 15m openshift-controller-manager 4.18.9 True False False 15m openshift-samples 4.18.9 True False False 4m57s operator-lifecycle-manager 4.18.9 True False False 15m operator-lifecycle-manager-catalog 4.18.9 True False False 15m operator-lifecycle-manager-packageserver 4.18.9 True False False 15m service-ca 4.18.9 True False False 6m2s storage 4.18.9 True False False 6m46s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.18.9 True False False 6m7s csi-snapshot-controller 4.18.9 True False False 16m dns 4.18.9 True False False 6m9s image-registry 4.18.9 True False False 6m7s ingress 4.18.9 True False False 5m58s insights 4.18.9 True False False 7m5s kube-apiserver 4.18.9 True False False 16m kube-controller-manager 4.18.9 True False False 16m kube-scheduler 4.18.9 True False False 16m kube-storage-version-migrator 4.18.9 True False False 7m1s monitoring 4.18.9 True False False 4m10s network 4.18.9 True False False 16m node-tuning 4.18.9 True False False 7m58s openshift-apiserver 4.18.9 True False False 16m openshift-controller-manager 4.18.9 True False False 16m openshift-samples 4.18.9 True False False 5m57s operator-lifecycle-manager 4.18.9 True False False 16m operator-lifecycle-manager-catalog 4.18.9 True False False 16m operator-lifecycle-manager-packageserver 4.18.9 True False False 16m service-ca 4.18.9 True False False 7m2s storage 4.18.9 True False False 7m46s Waiting for cluster to be reported as healthy... Trying again in 60s healthy cluster to be reported as healthy finished!