[must-gather ] OUT 2026-10-30T19:52:12.184245883Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 71480552-7c84-4ac2-94ca-20a3a789efeb ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-10-30T19:52:12.314020736Z namespace/openshift-must-gather-qlz2v created [must-gather ] OUT 2026-10-30T19:52:12.331425661Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-twsfm created [must-gather ] OUT 2026-10-30T19:52:12.369113446Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-h8nz7] OUT 2026-10-30T19:53:43.00590922Z waiting for gather to complete [must-gather-h8nz7] OUT 2026-10-30T19:53:43.022069515Z downloading gather output [must-gather-h8nz7] OUT 2026-10-30T19:53:43.563437867Z receiving incremental file list [must-gather-h8nz7] OUT 2026-10-30T19:53:43.617182259Z ./ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.617339312Z aggregated-discovery-api.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.618013508Z aggregated-discovery-apis.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.630706583Z event-filter.html [must-gather-h8nz7] OUT 2026-10-30T19:53:43.630853837Z timestamp [must-gather-h8nz7] OUT 2026-10-30T19:53:43.630967349Z version [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631098682Z namespaces/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631107532Z namespaces/opendatahub/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631201975Z namespaces/opendatahub/opendatahub.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631281727Z namespaces/opendatahub/apps.openshift.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631333948Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631394139Z namespaces/opendatahub/apps/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.63143414Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631540562Z namespaces/opendatahub/apps/deployments.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631686866Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631810439Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631860529Z namespaces/opendatahub/autoscaling/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631919601Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.631976232Z namespaces/opendatahub/batch/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.632028023Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.632112485Z namespaces/opendatahub/batch/jobs.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.632165367Z namespaces/opendatahub/build.openshift.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.632216888Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.63231027Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.632361691Z namespaces/opendatahub/core/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.632414992Z namespaces/opendatahub/core/configmaps.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.632562965Z namespaces/opendatahub/core/endpoints.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.632651297Z namespaces/opendatahub/core/events.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.632798871Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.632887543Z namespaces/opendatahub/core/pods.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.633040336Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.633179399Z namespaces/opendatahub/core/secrets.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.633387494Z namespaces/opendatahub/core/services.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.633452385Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.633506217Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.633590908Z namespaces/opendatahub/image.openshift.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.63364246Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.633764752Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.633812884Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.641227021Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.641376774Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.641489326Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.641680791Z namespaces/opendatahub/networking.k8s.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.641800864Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.641951017Z namespaces/opendatahub/pods/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.641958447Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-7wg9v/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.642011448Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-7wg9v/kubeflow-trainer-controller-manager-84b74c44f8-7wg9v.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.642125341Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-7wg9v/manager/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.642133511Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-7wg9v/manager/manager/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.642137651Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-7wg9v/manager/manager/logs/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.642188642Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-7wg9v/manager/manager/logs/current.log [must-gather-h8nz7] OUT 2026-10-30T19:53:43.654645533Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-7wg9v/manager/manager/logs/previous.insecure.log [must-gather-h8nz7] OUT 2026-10-30T19:53:43.654767476Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84b74c44f8-7wg9v/manager/manager/logs/previous.log [must-gather-h8nz7] OUT 2026-10-30T19:53:43.654822597Z namespaces/opendatahub/policy/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.654887519Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.65494282Z namespaces/opendatahub/route.openshift.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655006211Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655054442Z namespaces/openshift/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655108533Z namespaces/openshift/openshift.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655174695Z namespaces/openshift/apps.openshift.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655228096Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655285137Z namespaces/openshift/apps/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655335939Z namespaces/openshift/apps/daemonsets.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655435241Z namespaces/openshift/apps/deployments.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655523403Z namespaces/openshift/apps/replicasets.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655643316Z namespaces/openshift/apps/statefulsets.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655702897Z namespaces/openshift/autoscaling/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655747518Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655810219Z namespaces/openshift/batch/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655865251Z namespaces/openshift/batch/cronjobs.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.655952463Z namespaces/openshift/batch/jobs.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656003694Z namespaces/openshift/build.openshift.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656060585Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656154407Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656206988Z namespaces/openshift/core/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656258379Z namespaces/openshift/core/configmaps.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656373262Z namespaces/openshift/core/endpoints.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656461424Z namespaces/openshift/core/events.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656562176Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656680689Z namespaces/openshift/core/pods.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656766121Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.656916364Z namespaces/openshift/core/secrets.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.657100158Z namespaces/openshift/core/services.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.65715666Z namespaces/openshift/discovery.k8s.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.657211541Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.657261862Z namespaces/openshift/image.openshift.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.657314333Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.659029202Z namespaces/openshift/k8s.ovn.org/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.659082283Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.659188276Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.659228196Z namespaces/openshift/monitoring.coreos.com/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.659278307Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.659328059Z namespaces/openshift/networking.k8s.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.65938852Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.659438291Z namespaces/openshift/policy/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.659492372Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.659536243Z namespaces/openshift/route.openshift.io/ [must-gather-h8nz7] OUT 2026-10-30T19:53:43.659623325Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-h8nz7] OUT 2026-10-30T19:53:43.710230516Z [must-gather-h8nz7] OUT 2026-10-30T19:53:43.710260976Z sent 1,380 bytes received 146,798 bytes 296,356.00 bytes/sec [must-gather-h8nz7] OUT 2026-10-30T19:53:43.710271497Z total size is 1,832,203 speedup is 12.36 [must-gather ] OUT 2026-10-30T19:53:43.772719534Z namespace/openshift-must-gather-qlz2v deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 71480552-7c84-4ac2-94ca-20a3a789efeb ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing