[must-gather ] OUT 2026-10-30T16:15:49.823383751Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6a9f74c7-9243-42e7-b073-512672bb7a00 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-10-30T16:15:49.945421996Z namespace/openshift-must-gather-b42tz created [must-gather ] OUT 2026-10-30T16:15:49.96252161Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-whfs8 created [must-gather ] OUT 2026-10-30T16:15:49.999718744Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-9lnzp] OUT 2026-10-30T16:17:21.934235846Z waiting for gather to complete [must-gather-9lnzp] OUT 2026-10-30T16:17:21.948627245Z downloading gather output [must-gather-9lnzp] OUT 2026-10-30T16:17:22.483115303Z receiving incremental file list [must-gather-9lnzp] OUT 2026-10-30T16:17:22.549616361Z ./ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.549675935Z aggregated-discovery-api.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.550257137Z aggregated-discovery-apis.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.563288259Z event-filter.html [must-gather-9lnzp] OUT 2026-10-30T16:17:22.563374165Z timestamp [must-gather-9lnzp] OUT 2026-10-30T16:17:22.563518476Z version [must-gather-9lnzp] OUT 2026-10-30T16:17:22.563605292Z namespaces/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.563624413Z namespaces/opendatahub/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.563687918Z namespaces/opendatahub/opendatahub.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.563767093Z namespaces/opendatahub/apps.openshift.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.563792915Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.563849919Z namespaces/opendatahub/apps/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.563903953Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.56400354Z namespaces/opendatahub/apps/deployments.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.56414271Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.56428379Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.564337384Z namespaces/opendatahub/autoscaling/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.564395848Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.564443772Z namespaces/opendatahub/batch/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.564502276Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.564596933Z namespaces/opendatahub/batch/jobs.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.564651477Z namespaces/opendatahub/build.openshift.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.56470443Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.564800387Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.564852311Z namespaces/opendatahub/core/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.564907355Z namespaces/opendatahub/core/configmaps.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.565069876Z namespaces/opendatahub/core/endpoints.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.565198706Z namespaces/opendatahub/core/events.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.565345926Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.565442323Z namespaces/opendatahub/core/pods.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.565581583Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.565726634Z namespaces/opendatahub/core/secrets.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.565937779Z namespaces/opendatahub/core/services.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.566002363Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.566059947Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.566142703Z namespaces/opendatahub/image.openshift.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.566195977Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.566332097Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.566381581Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.574655412Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.574700656Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.574787202Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.574818714Z namespaces/opendatahub/networking.k8s.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.57489591Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.574930792Z namespaces/opendatahub/pods/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.574943263Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-hj8d2/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.575026719Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-hj8d2/kubeflow-trainer-controller-manager-84b74c44f8-hj8d2.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.575077363Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-hj8d2/manager/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.575098724Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-hj8d2/manager/manager/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.575108325Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-hj8d2/manager/manager/logs/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.575160309Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-hj8d2/manager/manager/logs/current.log [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589259297Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-hj8d2/manager/manager/logs/previous.insecure.log [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589360624Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-hj8d2/manager/manager/logs/previous.log [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589413308Z namespaces/opendatahub/policy/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589467932Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589532177Z namespaces/opendatahub/route.openshift.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589591711Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589649275Z namespaces/openshift/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.58971193Z namespaces/openshift/openshift.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589774964Z namespaces/openshift/apps.openshift.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589825478Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589886962Z namespaces/openshift/apps/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.589936535Z namespaces/openshift/apps/daemonsets.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590031982Z namespaces/openshift/apps/deployments.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590127789Z namespaces/openshift/apps/replicasets.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590252408Z namespaces/openshift/apps/statefulsets.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590306732Z namespaces/openshift/autoscaling/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590365346Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.59041685Z namespaces/openshift/batch/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590468624Z namespaces/openshift/batch/cronjobs.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590567651Z namespaces/openshift/batch/jobs.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590627265Z namespaces/openshift/build.openshift.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590675119Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590768795Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.59083734Z namespaces/openshift/core/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.590885243Z namespaces/openshift/core/configmaps.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591004822Z namespaces/openshift/core/endpoints.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591097799Z namespaces/openshift/core/events.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591236769Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591318254Z namespaces/openshift/core/pods.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591411491Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591565092Z namespaces/openshift/core/secrets.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591762266Z namespaces/openshift/core/services.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591827481Z namespaces/openshift/discovery.k8s.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591859813Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591924908Z namespaces/openshift/image.openshift.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.591975761Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.593577906Z namespaces/openshift/k8s.ovn.org/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.59362948Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.593734177Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.593781871Z namespaces/openshift/monitoring.coreos.com/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.593839525Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.593890429Z namespaces/openshift/networking.k8s.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.593945682Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.593997216Z namespaces/openshift/policy/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.59405144Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.594104594Z namespaces/openshift/route.openshift.io/ [must-gather-9lnzp] OUT 2026-10-30T16:17:22.59418785Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-9lnzp] OUT 2026-10-30T16:17:22.647189102Z [must-gather-9lnzp] OUT 2026-10-30T16:17:22.647224264Z sent 1,384 bytes received 155,116 bytes 313,000.00 bytes/sec [must-gather-9lnzp] OUT 2026-10-30T16:17:22.647239735Z total size is 1,961,789 speedup is 12.54 [must-gather ] OUT 2026-10-30T16:17:22.709535672Z namespace/openshift-must-gather-b42tz deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6a9f74c7-9243-42e7-b073-512672bb7a00 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing