[must-gather ] OUT 2026-11-03T04:15:41.511879426Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: e360c18c-425b-496b-8898-f3e535b16462 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-11-03T04:15:41.658082357Z namespace/openshift-must-gather-w55pg created [must-gather ] OUT 2026-11-03T04:15:41.679168941Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-bvqj2 created [must-gather ] OUT 2026-11-03T04:15:41.728806737Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-cd5zm] OUT 2026-11-03T04:18:58.978001429Z waiting for gather to complete [must-gather-cd5zm] OUT 2026-11-03T04:18:58.996928929Z downloading gather output [must-gather-cd5zm] OUT 2026-11-03T04:18:59.991699048Z receiving incremental file list [must-gather-cd5zm] OUT 2026-11-03T04:19:00.111356433Z ./ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.111401595Z aggregated-discovery-api.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.111886584Z aggregated-discovery-apis.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.122632164Z event-filter.html [must-gather-cd5zm] OUT 2026-11-03T04:19:00.122761701Z timestamp [must-gather-cd5zm] OUT 2026-11-03T04:19:00.122891719Z version [must-gather-cd5zm] OUT 2026-11-03T04:19:00.157350999Z namespaces/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.157377841Z namespaces/openshift/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.157477097Z namespaces/openshift/openshift.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.157626096Z namespaces/openshift/apps.openshift.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.15769798Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.157771724Z namespaces/openshift/apps/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.157848118Z namespaces/openshift/apps/daemonsets.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.157973776Z namespaces/openshift/apps/deployments.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158100553Z namespaces/openshift/apps/replicasets.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158226251Z namespaces/openshift/apps/statefulsets.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158281974Z namespaces/openshift/autoscaling/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158345968Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158402311Z namespaces/openshift/batch/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158454514Z namespaces/openshift/batch/cronjobs.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.15855841Z namespaces/openshift/batch/jobs.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158645845Z namespaces/openshift/build.openshift.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158690718Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158790954Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158848807Z namespaces/openshift/core/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.158911261Z namespaces/openshift/core/configmaps.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.159056379Z namespaces/openshift/core/endpoints.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.159163635Z namespaces/openshift/core/events.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.15924834Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.159343686Z namespaces/openshift/core/pods.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.159446632Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.159616292Z namespaces/openshift/core/secrets.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.159829665Z namespaces/openshift/core/services.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.159859586Z namespaces/openshift/discovery.k8s.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.159929871Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.159965593Z namespaces/openshift/image.openshift.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.160030136Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170098777Z namespaces/openshift/k8s.ovn.org/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170131469Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170244175Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170305189Z namespaces/openshift/monitoring.coreos.com/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170362542Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170444617Z namespaces/openshift/networking.k8s.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170461398Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170517861Z namespaces/openshift/policy/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170596206Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170656819Z namespaces/openshift/route.openshift.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170713373Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170819229Z namespaces/redhat-ods-applications/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.17083778Z namespaces/redhat-ods-applications/redhat-ods-applications.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.170899284Z namespaces/redhat-ods-applications/apps.openshift.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171032351Z namespaces/redhat-ods-applications/apps.openshift.io/deploymentconfigs.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171048852Z namespaces/redhat-ods-applications/apps/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171053643Z namespaces/redhat-ods-applications/apps/daemonsets.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171144388Z namespaces/redhat-ods-applications/apps/deployments.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171276786Z namespaces/redhat-ods-applications/apps/replicasets.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171403073Z namespaces/redhat-ods-applications/apps/statefulsets.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171455286Z namespaces/redhat-ods-applications/autoscaling/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.1715144Z namespaces/redhat-ods-applications/autoscaling/horizontalpodautoscalers.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171610675Z namespaces/redhat-ods-applications/batch/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171629216Z namespaces/redhat-ods-applications/batch/cronjobs.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171736193Z namespaces/redhat-ods-applications/batch/jobs.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171791846Z namespaces/redhat-ods-applications/build.openshift.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171843609Z namespaces/redhat-ods-applications/build.openshift.io/buildconfigs.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171942355Z namespaces/redhat-ods-applications/build.openshift.io/builds.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.171994128Z namespaces/redhat-ods-applications/core/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.172047851Z namespaces/redhat-ods-applications/core/configmaps.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.172182299Z namespaces/redhat-ods-applications/core/endpoints.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.172287675Z namespaces/redhat-ods-applications/core/events.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.172657327Z namespaces/redhat-ods-applications/core/persistentvolumeclaims.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.172757663Z namespaces/redhat-ods-applications/core/pods.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.172901051Z namespaces/redhat-ods-applications/core/replicationcontrollers.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173048209Z namespaces/redhat-ods-applications/core/secrets.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173237911Z namespaces/redhat-ods-applications/core/services.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173304735Z namespaces/redhat-ods-applications/discovery.k8s.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173370139Z namespaces/redhat-ods-applications/discovery.k8s.io/endpointslices.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173432902Z namespaces/redhat-ods-applications/image.openshift.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173478365Z namespaces/redhat-ods-applications/image.openshift.io/imagestreams.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173633084Z namespaces/redhat-ods-applications/k8s.ovn.org/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173686977Z namespaces/redhat-ods-applications/k8s.ovn.org/egressfirewalls.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173787253Z namespaces/redhat-ods-applications/k8s.ovn.org/egressqoses.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173827025Z namespaces/redhat-ods-applications/monitoring.coreos.com/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173894739Z namespaces/redhat-ods-applications/monitoring.coreos.com/servicemonitors.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.173948372Z namespaces/redhat-ods-applications/networking.k8s.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.174008116Z namespaces/redhat-ods-applications/networking.k8s.io/networkpolicies.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.174066439Z namespaces/redhat-ods-applications/pods/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.17407418Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-5949dcbb4-swp4b/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.174134323Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-5949dcbb4-swp4b/kubeflow-trainer-controller-manager-5949dcbb4-swp4b.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.174236199Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-5949dcbb4-swp4b/manager/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.17424641Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-5949dcbb4-swp4b/manager/manager/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.17425285Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-5949dcbb4-swp4b/manager/manager/logs/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.174293153Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-5949dcbb4-swp4b/manager/manager/logs/current.log [must-gather-cd5zm] OUT 2026-11-03T04:19:00.175228637Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-5949dcbb4-swp4b/manager/manager/logs/previous.insecure.log [must-gather-cd5zm] OUT 2026-11-03T04:19:00.175318723Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-5949dcbb4-swp4b/manager/manager/logs/previous.log [must-gather-cd5zm] OUT 2026-11-03T04:19:00.175357775Z namespaces/redhat-ods-applications/policy/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.175422889Z namespaces/redhat-ods-applications/policy/poddisruptionbudgets.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.175477042Z namespaces/redhat-ods-applications/route.openshift.io/ [must-gather-cd5zm] OUT 2026-11-03T04:19:00.175544626Z namespaces/redhat-ods-applications/route.openshift.io/routes.yaml [must-gather-cd5zm] OUT 2026-11-03T04:19:00.290947752Z [must-gather-cd5zm] OUT 2026-11-03T04:19:00.290982854Z sent 1,380 bytes received 97,012 bytes 65,594.67 bytes/sec [must-gather-cd5zm] OUT 2026-11-03T04:19:00.290991574Z total size is 1,141,492 speedup is 11.60 [must-gather ] OUT 2026-11-03T04:19:00.394360714Z namespace/openshift-must-gather-w55pg deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: e360c18c-425b-496b-8898-f3e535b16462 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing