INFO: Log in to your Red Hat account... INFO: Configure AWS Credentials... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.59). WARN: It is recommended that you update to the latest version. INFO: Logged in as 'rhtap-shared' on 'https://api.openshift.com' INFO: Create ROSA with HCP cluster... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.59). WARN: It is recommended that you update to the latest version. INFO: Creating cluster 'kx-534c5bbe4b' INFO: To view a list of clusters and their status, run 'rosa list clusters' INFO: Cluster 'kx-534c5bbe4b' has been created. INFO: Once the cluster is installed you will need to add an Identity Provider before you can login into the cluster. See 'rosa create idp --help' for more information. Name: kx-534c5bbe4b Domain Prefix: kx-534c5bbe4b Display Name: kx-534c5bbe4b ID: 2ndpmc4n84rpgsr1v5n61d5ruv84vrnn External ID: 3478319e-567c-4e27-b9a9-be24e19c8cdf Control Plane: ROSA Service Hosted OpenShift Version: 4.19.9 Channel Group: stable DNS: Not ready AWS Account: 381492310364 AWS Billing Account: 381492310364 API URL: Console URL: Region: us-east-1 Availability: - Control Plane: MultiAZ - Data Plane: MultiAZ Nodes: - Compute (desired): 3 - Compute (current): 0 Network: - Type: OVNKubernetes - Service CIDR: 172.30.0.0/16 - Machine CIDR: 10.0.0.0/16 - Pod CIDR: 10.128.0.0/14 - Host Prefix: /23 - Subnets: subnet-0208a6297964e4fe1, subnet-0c161c939f7025e15, subnet-023e5c7b3016ed194, subnet-02dbd8abbf884d77f, subnet-0360c2d20442c5ba5, subnet-0aad9c992e402a91a EC2 Metadata Http Tokens: optional Role (STS) ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Installer-Role Support Role ARN: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Support-Role Instance IAM Roles: - Worker: arn:aws:iam::381492310364:role/rhads-hcp-HCP-ROSA-Worker-Role Operator IAM Roles: - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kms-provider - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cloud-network-config-controller-cloud-creden - arn:aws:iam::381492310364:role/rhads-hcp-openshift-image-registry-installer-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-ingress-operator-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-openshift-cluster-csi-drivers-ebs-cloud-credentials - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-kube-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-capa-controller-manager - arn:aws:iam::381492310364:role/rhads-hcp-kube-system-control-plane-operator Managed Policies: Yes State: waiting (Waiting for user action) Private: No Delete Protection: Disabled Created: Dec 26 2025 01:47:33 UTC [DEPRECATED] User Workload Monitoring: Enabled Details Page: https://console.redhat.com/openshift/details/s/37MWvrjAX2B3IytOXhskibzkP5F OIDC Endpoint URL: https://oidc.op1.openshiftapps.com/2jtsga3i2etnl697l7bk5i1kmbm4a95j (Managed) Etcd Encryption: Disabled Audit Log Forwarding: Disabled External Authentication: Disabled Zero Egress: Disabled INFO: Preparing to create operator roles. INFO: Operator Roles already exists INFO: Preparing to create OIDC Provider. INFO: OIDC provider already exists INFO: To determine when your cluster is Ready, run 'rosa describe cluster -c kx-534c5bbe4b'. INFO: To watch your cluster installation logs, run 'rosa logs install -c kx-534c5bbe4b --watch'. INFO: Track the progress of the cluster creation... WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.59). WARN: It is recommended that you update to the latest version. W: Region flag will be removed from this command in future versions INFO: Cluster 'kx-534c5bbe4b' is in waiting state waiting for installation to begin. Logs will show up within 5 minutes 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-534c5bbe4b Version 2025-12-26 01:53:10 +0000 UTC hostedclusters kx-534c5bbe4b ValidAWSIdentityProvider StatusUnknown 2025-12-26 01:53:11 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2025-12-26 01:53:11 +0000 UTC certificates cluster-api-cert Issuing certificate as Secret does not exist 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Ignition server deployment not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b HostedCluster is supported by operator configuration 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Release image is valid 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Reconciliation active on resource 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Ignition server deployment not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b HostedCluster is supported by operator configuration 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Release image is valid 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Reconciliation active on resource 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Ignition server deployment not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b HostedCluster is supported by operator configuration 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Release image is valid 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Reconciliation active on resource 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Ignition server deployment not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b HostedCluster is supported by operator configuration 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Release image is valid 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Reconciliation active on resource 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Ignition server deployment not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b HostedCluster is supported by operator configuration 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Release image is valid 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Reconciliation active on resource 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Ignition server deployment not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b HostedCluster is supported by operator configuration 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Release image is valid 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Reconciliation active on resource 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b configuration is invalid: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b ValidConfiguration condition is false: NamedCertificates get secret: Invalid value: "cluster-api-cert": Secret "cluster-api-cert" not found 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-534c5bbe4b Version 2025-12-26 01:53:10 +0000 UTC hostedclusters kx-534c5bbe4b ValidAWSIdentityProvider StatusUnknown 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Release image is valid 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the HCP 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b HostedCluster is at expected version 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Reconciliation active on resource 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Ignition server deployment not found 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b HostedCluster is supported by operator configuration 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b router load balancer is not provisioned; 7s since creation.; router load balancer is not provisioned; 7s since creation. 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Condition not found in the CVO. 2025-12-26 01:54:36 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-12-26 01:54:40 +0000 UTC hostedclusters kx-534c5bbe4b Configuration passes validation 2025-12-26 01:54:41 +0000 UTC hostedclusters kx-534c5bbe4b Required platform credentials are found 2025-12-26 01:54:45 +0000 UTC hostedclusters kx-534c5bbe4b OIDC configuration is valid 2025-12-26 01:54:45 +0000 UTC hostedclusters kx-534c5bbe4b Reconciliation completed successfully 2025-12-26 01:54:48 +0000 UTC hostedclusters kx-534c5bbe4b router load balancer is not provisioned; 7s since creation.; router load balancer is not provisioned; 7s since creation. 2025-12-26 01:54:48 +0000 UTC hostedclusters kx-534c5bbe4b lookup api.kx-534c5bbe4b.u94d.p3.openshiftapps.com on 172.30.0.10:53: no such host 2025-12-26 01:54:48 +0000 UTC hostedclusters kx-534c5bbe4b Configuration passes validation 2025-12-26 01:54:48 +0000 UTC hostedclusters kx-534c5bbe4b capi-provider deployment has 1 unavailable replicas 2025-12-26 01:54:48 +0000 UTC hostedclusters kx-534c5bbe4b AWS KMS is not configured 2025-12-26 01:54:48 +0000 UTC hostedclusters kx-534c5bbe4b EtcdAvailable StatefulSetNotFound 2025-12-26 01:54:48 +0000 UTC hostedclusters kx-534c5bbe4b Kube APIServer deployment not found 2025-12-26 01:55:09 +0000 UTC hostedclusters kx-534c5bbe4b All is well 2025-12-26 01:55:09 +0000 UTC hostedclusters kx-534c5bbe4b All is well 2025-12-26 01:55:17 +0000 UTC hostedclusters kx-534c5bbe4b WebIdentityErr 2025-12-26 01:55:35 +0000 UTC hostedclusters kx-534c5bbe4b EtcdAvailable QuorumAvailable 2025-12-26 01:56:10 +0000 UTC hostedclusters kx-534c5bbe4b Kube APIServer deployment is available 2025-12-26 01:56:17 +0000 UTC hostedclusters kx-534c5bbe4b All is well 2025-12-26 01:56:43 +0000 UTC hostedclusters kx-534c5bbe4b All is well 2025-12-26 01:56:47 +0000 UTC hostedclusters kx-534c5bbe4b Ignition server deployment is available 2025-12-26 01:57:39 +0000 UTC hostedclusters kx-534c5bbe4b Unable to apply 4.19.9: an unknown error has occurred: MultipleErrors 2025-12-26 01:57:39 +0000 UTC hostedclusters kx-534c5bbe4b Payload loaded version="4.19.9" image="quay.io/openshift-release-dev/ocp-release@sha256:fda39a9c5701bf35da74263177d8976d4bd9205e69b9a9d5834389f71005d51a" architecture="Multi" 2025-12-26 01:57:39 +0000 UTC hostedclusters kx-534c5bbe4b ClusterVersionAvailable FromClusterVersion 2025-12-26 01:57:40 +0000 UTC hostedclusters kx-534c5bbe4b An update is already in progress and the details are in the Progressing condition 2025-12-26 01:58:03 +0000 UTC hostedclusters kx-534c5bbe4b lookup api.kx-534c5bbe4b.u94d.p3.openshiftapps.com on 172.30.0.10:53: no such host 2025-12-26 01:58:03 +0000 UTC hostedclusters kx-534c5bbe4b Multiple errors are preventing progress: * Cluster operators console, csi-snapshot-controller, dns, ingress, insights, kube-storage-version-migrator, monitoring, network, node-tuning, openshift-samples, service-ca, storage are not available * Could not update imagestream "openshift/driver-toolkit" (447 of 629): resource may have been deleted * Could not update operatorgroup "openshift-monitoring/openshift-cluster-monitoring" (570 of 629): resource may have been deleted * Could not update role "openshift-authentication/prometheus-k8s" (557 of 629): resource may have been deleted * Could not update role "openshift-console-operator/prometheus-k8s" (587 of 629): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (591 of 629): resource may have been deleted * Could not update role "openshift-ingress-operator/prometheus-k8s" (598 of 629): resource may have been deleted * Could not update role "openshift-kube-apiserver-operator/prometheus-k8s" (602 of 629): resource may have been deleted 2025-12-26 01:58:07 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is available 0001-01-01 00:00:00 +0000 UTC hostedclusters kx-534c5bbe4b Version 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b HostedCluster is at expected version 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Reconciliation active on resource 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b Release image is valid 2025-12-26 01:53:14 +0000 UTC hostedclusters kx-534c5bbe4b HostedCluster is supported by operator configuration 2025-12-26 01:54:36 +0000 UTC certificates cluster-api-cert Certificate is up to date and has not expired 2025-12-26 01:54:40 +0000 UTC hostedclusters kx-534c5bbe4b Configuration passes validation 2025-12-26 01:54:41 +0000 UTC hostedclusters kx-534c5bbe4b Required platform credentials are found 2025-12-26 01:54:45 +0000 UTC hostedclusters kx-534c5bbe4b Reconciliation completed successfully 2025-12-26 01:54:45 +0000 UTC hostedclusters kx-534c5bbe4b OIDC configuration is valid 2025-12-26 01:54:48 +0000 UTC hostedclusters kx-534c5bbe4b Configuration passes validation 2025-12-26 01:54:48 +0000 UTC hostedclusters kx-534c5bbe4b AWS KMS is not configured 2025-12-26 01:55:09 +0000 UTC hostedclusters kx-534c5bbe4b All is well 2025-12-26 01:55:09 +0000 UTC hostedclusters kx-534c5bbe4b All is well 2025-12-26 01:55:35 +0000 UTC hostedclusters kx-534c5bbe4b EtcdAvailable QuorumAvailable 2025-12-26 01:56:10 +0000 UTC hostedclusters kx-534c5bbe4b Kube APIServer deployment is available 2025-12-26 01:56:17 +0000 UTC hostedclusters kx-534c5bbe4b All is well 2025-12-26 01:56:43 +0000 UTC hostedclusters kx-534c5bbe4b All is well 2025-12-26 01:56:47 +0000 UTC hostedclusters kx-534c5bbe4b Ignition server deployment is available 2025-12-26 01:57:39 +0000 UTC hostedclusters kx-534c5bbe4b Unable to apply 4.19.9: some cluster operators are not available 2025-12-26 01:57:39 +0000 UTC hostedclusters kx-534c5bbe4b Payload loaded version="4.19.9" image="quay.io/openshift-release-dev/ocp-release@sha256:fda39a9c5701bf35da74263177d8976d4bd9205e69b9a9d5834389f71005d51a" architecture="Multi" 2025-12-26 01:57:39 +0000 UTC hostedclusters kx-534c5bbe4b ClusterVersionAvailable FromClusterVersion 2025-12-26 01:57:40 +0000 UTC hostedclusters kx-534c5bbe4b An update is already in progress and the details are in the Progressing condition 2025-12-26 01:58:03 +0000 UTC hostedclusters kx-534c5bbe4b Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available 2025-12-26 01:58:20 +0000 UTC hostedclusters kx-534c5bbe4b The hosted cluster is not degraded 2025-12-26 01:58:36 +0000 UTC hostedclusters kx-534c5bbe4b All is well 2025-12-26 01:58:38 +0000 UTC hostedclusters kx-534c5bbe4b The hosted control plane is available INFO: Cluster 'kx-534c5bbe4b' is now ready INFO: ROSA with HCP cluster is ready, create a cluster admin account for accessing the cluster WARN: The current version (1.2.56) is not up to date with latest rosa cli released version (1.2.59). WARN: It is recommended that you update to the latest version. INFO: Storing login command... INFO: Check if it's able to login to OCP cluster... Retried 1 times... INFO: Check if apiserver is ready... Waiting for cluster operators to be accessible for 2m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 2m57s dns 4.19.9 False False True 3m9s DNS "default" is unavailable. image-registry False True True 3m Available: The deployment does not have available replicas... ingress False True True 2m45s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 3m7s kube-controller-manager 4.19.9 True False False 3m7s kube-scheduler 4.19.9 True False False 3m7s kube-storage-version-migrator monitoring network 4.19.9 True True False 2m37s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 3m15s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 3m8s openshift-controller-manager 4.19.9 True False False 3m7s openshift-samples operator-lifecycle-manager 4.19.9 True False False 2m59s operator-lifecycle-manager-catalog 4.19.9 True False False 3m1s operator-lifecycle-manager-packageserver 4.19.9 True False False 3m7s service-ca storage 4.19.9 False False False 3m7s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service cluster operators to be accessible finished! [INFO] Cluster operators are accessible. Waiting for cluster to be reported as healthy for 60m... NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 2m57s dns 4.19.9 False False True 3m9s DNS "default" is unavailable. image-registry False True True 3m Available: The deployment does not have available replicas... ingress False True True 2m45s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 3m7s kube-controller-manager 4.19.9 True False False 3m7s kube-scheduler 4.19.9 True False False 3m7s kube-storage-version-migrator monitoring network 4.19.9 True True False 2m37s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 3m15s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 3m8s openshift-controller-manager 4.19.9 True False False 3m7s openshift-samples operator-lifecycle-manager 4.19.9 True False False 2m59s operator-lifecycle-manager-catalog 4.19.9 True False False 3m1s operator-lifecycle-manager-packageserver 4.19.9 True False False 3m7s service-ca storage 4.19.9 False False False 3m7s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 3m57s dns 4.19.9 False False True 4m9s DNS "default" is unavailable. image-registry False True True 4m Available: The deployment does not have available replicas... ingress False True True 3m45s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 4m7s kube-controller-manager 4.19.9 True False False 4m7s kube-scheduler 4.19.9 True False False 4m7s kube-storage-version-migrator monitoring network 4.19.9 True True False 3m37s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 4m15s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 4m8s openshift-controller-manager 4.19.9 True False False 4m7s openshift-samples operator-lifecycle-manager 4.19.9 True False False 3m59s operator-lifecycle-manager-catalog 4.19.9 True False False 4m1s operator-lifecycle-manager-packageserver 4.19.9 True False False 4m7s service-ca storage 4.19.9 False False False 4m7s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 4m58s dns 4.19.9 False False True 5m10s DNS "default" is unavailable. image-registry False True True 5m1s Available: The deployment does not have available replicas... ingress False True True 4m46s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 5m8s kube-controller-manager 4.19.9 True False False 5m8s kube-scheduler 4.19.9 True False False 5m8s kube-storage-version-migrator monitoring network 4.19.9 True True False 4m38s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 5m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 5m9s openshift-controller-manager 4.19.9 True False False 5m8s openshift-samples operator-lifecycle-manager 4.19.9 True False False 5m operator-lifecycle-manager-catalog 4.19.9 True False False 5m2s operator-lifecycle-manager-packageserver 4.19.9 True False False 5m8s service-ca storage 4.19.9 False False False 5m8s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 5m58s dns 4.19.9 False False True 6m10s DNS "default" is unavailable. image-registry False True True 6m1s Available: The deployment does not have available replicas... ingress False True True 5m46s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 6m8s kube-controller-manager 4.19.9 True False False 6m8s kube-scheduler 4.19.9 True False False 6m8s kube-storage-version-migrator monitoring network 4.19.9 True True False 5m38s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 6m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 6m9s openshift-controller-manager 4.19.9 True False False 6m8s openshift-samples operator-lifecycle-manager 4.19.9 True False False 6m operator-lifecycle-manager-catalog 4.19.9 True False False 6m2s operator-lifecycle-manager-packageserver 4.19.9 True False False 6m8s service-ca storage 4.19.9 False False False 6m8s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 6m58s dns 4.19.9 False False True 7m10s DNS "default" is unavailable. image-registry False True True 7m1s Available: The deployment does not have available replicas... ingress False True True 6m46s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 7m8s kube-controller-manager 4.19.9 True False False 7m8s kube-scheduler 4.19.9 True False False 7m8s kube-storage-version-migrator monitoring network 4.19.9 True True False 6m38s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning False True False 7m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 7m9s openshift-controller-manager 4.19.9 True False False 7m8s openshift-samples operator-lifecycle-manager 4.19.9 True False False 7m operator-lifecycle-manager-catalog 4.19.9 True False False 7m2s operator-lifecycle-manager-packageserver 4.19.9 True False False 7m8s service-ca storage 4.19.9 False False False 7m8s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 7m58s dns 4.19.9 False True True 8m10s DNS "default" is unavailable. image-registry False True True 8m1s Available: The deployment does not have available replicas... ingress False True True 7m46s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights kube-apiserver 4.19.9 True False False 8m8s kube-controller-manager 4.19.9 True False False 8m8s kube-scheduler 4.19.9 True False False 8m8s kube-storage-version-migrator monitoring network 4.19.9 True True False 7m38s DaemonSet "/openshift-multus/multus" is not available (awaiting 2 nodes)... node-tuning False True False 8m16s DaemonSet "tuned" has no available Pod(s) openshift-apiserver 4.19.9 True False False 8m9s openshift-controller-manager 4.19.9 True False False 8m8s openshift-samples operator-lifecycle-manager 4.19.9 True False False 8m operator-lifecycle-manager-catalog 4.19.9 True False False 8m2s operator-lifecycle-manager-packageserver 4.19.9 True False False 8m8s service-ca storage 4.19.9 False True False 8m8s AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console csi-snapshot-controller 4.19.9 True False False 8m59s dns 4.19.9 False False True 9m11s DNS "default" is unavailable. image-registry False True True 9m2s Available: The deployment does not have available replicas... ingress False True True 8m47s The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: DeploymentAvailable=False (DeploymentUnavailable: The deployment has Available status condition set to False (reason: MinimumReplicasUnavailable) with message: Deployment does not have minimum availability.) insights 4.19.9 True False False 4s kube-apiserver 4.19.9 True False False 9m9s kube-controller-manager 4.19.9 True False False 9m9s kube-scheduler 4.19.9 True False False 9m9s kube-storage-version-migrator 4.19.9 True False False 1s monitoring network 4.19.9 True True False 8m39s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready... node-tuning 4.19.9 True False False 51s openshift-apiserver 4.19.9 True False False 9m10s openshift-controller-manager 4.19.9 True False False 9m9s openshift-samples operator-lifecycle-manager 4.19.9 True False False 9m1s operator-lifecycle-manager-catalog 4.19.9 True False False 9m3s operator-lifecycle-manager-packageserver 4.19.9 True False False 9m9s service-ca True True False 2s Progressing: ... storage 4.19.9 True False False 39s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.19.9 True True False 21s SyncLoopRefreshProgressing: working toward version 4.19.9, 1 replicas available csi-snapshot-controller 4.19.9 True False False 9m59s dns 4.19.9 True False False 32s image-registry True True False 28s Progressing: The deployment has not completed... ingress 4.19.9 True False True 2s The "default" ingress controller reports Degraded=True: DegradedConditions: One or more other status conditions indicate a degraded state: CanaryChecksSucceeding=Unknown (CanaryRouteNotAdmitted: Canary route is not admitted by the default ingress controller). insights 4.19.9 True False False 64s kube-apiserver 4.19.9 True False False 10m kube-controller-manager 4.19.9 True False False 10m kube-scheduler 4.19.9 True False False 10m kube-storage-version-migrator 4.19.9 True False False 61s monitoring Unknown True Unknown 34s Rolling out the stack. network 4.19.9 True True False 9m39s DaemonSet "/openshift-multus/network-metrics-daemon" is waiting for other operators to become ready node-tuning 4.19.9 True False False 111s openshift-apiserver 4.19.9 True False False 10m openshift-controller-manager 4.19.9 True False False 10m openshift-samples 4.19.9 True False False 18s operator-lifecycle-manager 4.19.9 True False False 10m operator-lifecycle-manager-catalog 4.19.9 True False False 10m operator-lifecycle-manager-packageserver 4.19.9 True False False 10m service-ca 4.19.9 True False False 62s storage 4.19.9 True False False 99s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.19.9 True False False 81s csi-snapshot-controller 4.19.9 True False False 10m dns 4.19.9 True False False 92s image-registry 4.19.9 True False False 88s ingress 4.19.9 True False False 62s insights 4.19.9 True False False 2m4s kube-apiserver 4.19.9 True False False 11m kube-controller-manager 4.19.9 True False False 11m kube-scheduler 4.19.9 True False False 11m kube-storage-version-migrator 4.19.9 True False False 2m1s monitoring Unknown True Unknown 94s Rolling out the stack. network 4.19.9 True False False 10m node-tuning 4.19.9 True False False 2m51s openshift-apiserver 4.19.9 True False False 11m openshift-controller-manager 4.19.9 True False False 11m openshift-samples 4.19.9 True False False 78s operator-lifecycle-manager 4.19.9 True False False 11m operator-lifecycle-manager-catalog 4.19.9 True False False 11m operator-lifecycle-manager-packageserver 4.19.9 True False False 11m service-ca 4.19.9 True False False 2m2s storage 4.19.9 True False False 2m39s Waiting for cluster to be reported as healthy... Trying again in 60s NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE console 4.19.9 True False False 2m21s csi-snapshot-controller 4.19.9 True False False 11m dns 4.19.9 True False False 2m32s image-registry 4.19.9 True False False 2m28s ingress 4.19.9 True False False 2m2s insights 4.19.9 True False False 3m4s kube-apiserver 4.19.9 True False False 12m kube-controller-manager 4.19.9 True False False 12m kube-scheduler 4.19.9 True False False 12m kube-storage-version-migrator 4.19.9 True False False 3m1s monitoring Unknown True Unknown 2m34s Rolling out the stack. network 4.19.9 True False False 11m node-tuning 4.19.9 True False False 3m51s openshift-apiserver 4.19.9 True False False 12m openshift-controller-manager 4.19.9 True False False 12m openshift-samples 4.19.9 True False False 2m18s operator-lifecycle-manager 4.19.9 True False False 12m operator-lifecycle-manager-catalog 4.19.9 True False False 12m operator-lifecycle-manager-packageserver 4.19.9 True False False 12m service-ca 4.19.9 True False False 3m2s storage 4.19.9 True False False 3m39s Waiting for cluster to be reported as healthy... Trying again in 60s healthy cluster to be reported as healthy finished!