[must-gather ] OUT 2026-11-03T18:02:27.573562876Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 7b234c93-756b-473a-8b62-d714b8e21915 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-11-03T18:02:27.71501514Z namespace/openshift-must-gather-87q2s created [must-gather ] OUT 2026-11-03T18:02:27.733042451Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-trd79 created [must-gather ] OUT 2026-11-03T18:02:27.780855759Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-f87nj] OUT 2026-11-03T18:05:42.155452207Z waiting for gather to complete [must-gather-f87nj] OUT 2026-11-03T18:05:42.172180265Z downloading gather output [must-gather-f87nj] OUT 2026-11-03T18:05:43.191264367Z receiving incremental file list [must-gather-f87nj] OUT 2026-11-03T18:05:43.36939653Z ./ [must-gather-f87nj] OUT 2026-11-03T18:05:43.369441711Z aggregated-discovery-api.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.369864979Z aggregated-discovery-apis.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.370751477Z event-filter.html [must-gather-f87nj] OUT 2026-11-03T18:05:43.370873159Z timestamp [must-gather-f87nj] OUT 2026-11-03T18:05:43.382003107Z version [must-gather-f87nj] OUT 2026-11-03T18:05:43.418596485Z namespaces/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.418636786Z namespaces/opendatahub/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.418889951Z namespaces/opendatahub/opendatahub.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.419123955Z namespaces/opendatahub/apps.openshift.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.419254778Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.419399251Z namespaces/opendatahub/apps/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.419458172Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.419553544Z namespaces/opendatahub/apps/deployments.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.419741717Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.41987879Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.419930731Z namespaces/opendatahub/autoscaling/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.419991022Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.420043453Z namespaces/opendatahub/batch/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.420097134Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.420190286Z namespaces/opendatahub/batch/jobs.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.420238307Z namespaces/opendatahub/build.openshift.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.420290448Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.42038402Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.420431041Z namespaces/opendatahub/core/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.420487202Z namespaces/opendatahub/core/configmaps.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.420638245Z namespaces/opendatahub/core/endpoints.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.420764797Z namespaces/opendatahub/core/events.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.42089808Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.420990992Z namespaces/opendatahub/core/pods.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.421130205Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.421280558Z namespaces/opendatahub/core/secrets.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.421484371Z namespaces/opendatahub/core/services.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.421556793Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.421608044Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.421690846Z namespaces/opendatahub/image.openshift.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.421744297Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.431466327Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.431571409Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.431705662Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.431761913Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.431852815Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.431929907Z namespaces/opendatahub/networking.k8s.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.432002418Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.43210036Z namespaces/opendatahub/pods/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.43211225Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-k2jcm/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.432170511Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-k2jcm/kubeflow-trainer-controller-manager-84d6d98cc8-k2jcm.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.432314064Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-k2jcm/manager/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.432325594Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-k2jcm/manager/manager/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.432333114Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-k2jcm/manager/manager/logs/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.432381715Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-k2jcm/manager/manager/logs/current.log [must-gather-f87nj] OUT 2026-11-03T18:05:43.432589659Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-k2jcm/manager/manager/logs/previous.insecure.log [must-gather-f87nj] OUT 2026-11-03T18:05:43.432697351Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-k2jcm/manager/manager/logs/previous.log [must-gather-f87nj] OUT 2026-11-03T18:05:43.432753813Z namespaces/opendatahub/policy/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.432807124Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.432863885Z namespaces/opendatahub/route.openshift.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.432913166Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.432970757Z namespaces/openshift/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.433025508Z namespaces/openshift/openshift.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.433089179Z namespaces/openshift/apps.openshift.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.4331326Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.433189841Z namespaces/openshift/apps/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.433228822Z namespaces/openshift/apps/daemonsets.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.433331414Z namespaces/openshift/apps/deployments.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.433421826Z namespaces/openshift/apps/replicasets.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.433516247Z namespaces/openshift/apps/statefulsets.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.433572059Z namespaces/openshift/autoscaling/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.43362223Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.433684471Z namespaces/openshift/batch/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.433746712Z namespaces/openshift/batch/cronjobs.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.433833794Z namespaces/openshift/batch/jobs.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.433889695Z namespaces/openshift/build.openshift.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.433937396Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.434032018Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.434080639Z namespaces/openshift/core/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.43413316Z namespaces/openshift/core/configmaps.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.434243852Z namespaces/openshift/core/endpoints.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.434331283Z namespaces/openshift/core/events.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.434427976Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.434514677Z namespaces/openshift/core/pods.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.43465563Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.434882764Z namespaces/openshift/core/secrets.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.435107629Z namespaces/openshift/core/services.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.435209241Z namespaces/openshift/discovery.k8s.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.435272502Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.435352743Z namespaces/openshift/image.openshift.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.435405395Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.437288652Z namespaces/openshift/k8s.ovn.org/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.437344082Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.437438984Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.437491545Z namespaces/openshift/monitoring.coreos.com/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.437545886Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.437600798Z namespaces/openshift/networking.k8s.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.437657869Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.43774633Z namespaces/openshift/policy/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.437794511Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.437854343Z namespaces/openshift/route.openshift.io/ [must-gather-f87nj] OUT 2026-11-03T18:05:43.437900104Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-f87nj] OUT 2026-11-03T18:05:43.565478425Z [must-gather-f87nj] OUT 2026-11-03T18:05:43.565503646Z sent 1,380 bytes received 73,168 bytes 49,698.67 bytes/sec [must-gather-f87nj] OUT 2026-11-03T18:05:43.565510026Z total size is 876,547 speedup is 11.76 [must-gather ] OUT 2026-11-03T18:05:43.668146848Z namespace/openshift-must-gather-87q2s deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 7b234c93-756b-473a-8b62-d714b8e21915 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing