[must-gather ] OUT 2026-11-03T13:46:47.257045859Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: f024a330-b7c2-49f0-ae89-fa0928b7a74d ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-11-03T13:46:47.393301094Z namespace/openshift-must-gather-7w7nv created [must-gather ] OUT 2026-11-03T13:46:47.413525323Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-hs9l9 created [must-gather ] OUT 2026-11-03T13:46:47.474574258Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-bp2wg] OUT 2026-11-03T13:49:07.924909375Z waiting for gather to complete [must-gather-bp2wg] OUT 2026-11-03T13:49:07.939985578Z downloading gather output [must-gather-bp2wg] OUT 2026-11-03T13:49:08.45914521Z receiving incremental file list [must-gather-bp2wg] OUT 2026-11-03T13:49:08.525676629Z ./ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.525764844Z aggregated-discovery-api.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.526171627Z aggregated-discovery-apis.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.527346572Z event-filter.html [must-gather-bp2wg] OUT 2026-11-03T13:49:08.527471838Z timestamp [must-gather-bp2wg] OUT 2026-11-03T13:49:08.538400533Z version [must-gather-bp2wg] OUT 2026-11-03T13:49:08.53852632Z namespaces/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.538545231Z namespaces/opendatahub/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.538623735Z namespaces/opendatahub/opendatahub.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.538731551Z namespaces/opendatahub/apps.openshift.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.538811306Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.538900711Z namespaces/opendatahub/apps/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.538960644Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.539083011Z namespaces/opendatahub/apps/deployments.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.5392485Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.539404758Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.539473402Z namespaces/opendatahub/autoscaling/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.539523505Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.5396017Z namespaces/opendatahub/batch/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.539639631Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.539742817Z namespaces/opendatahub/batch/jobs.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.539810681Z namespaces/opendatahub/build.openshift.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.539876595Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.53997639Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.540014562Z namespaces/opendatahub/core/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.540081956Z namespaces/opendatahub/core/configmaps.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.540220284Z namespaces/opendatahub/core/endpoints.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.54033425Z namespaces/opendatahub/core/events.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.540479368Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.540576873Z namespaces/opendatahub/core/pods.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.540728812Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.540899471Z namespaces/opendatahub/core/secrets.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541102912Z namespaces/opendatahub/core/services.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541174026Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.54122967Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541295763Z namespaces/opendatahub/image.openshift.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541344726Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541408119Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541457162Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541556397Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541610091Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541669364Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541731897Z namespaces/opendatahub/networking.k8s.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.5417875Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541866755Z namespaces/opendatahub/pods/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541888916Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-78776db7c7-hvtgq/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.541934098Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-78776db7c7-hvtgq/kubeflow-trainer-controller-manager-78776db7c7-hvtgq.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.551494337Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-78776db7c7-hvtgq/manager/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.551513548Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-78776db7c7-hvtgq/manager/manager/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.551518899Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-78776db7c7-hvtgq/manager/manager/logs/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.551594693Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-78776db7c7-hvtgq/manager/manager/logs/current.log [must-gather-bp2wg] OUT 2026-11-03T13:49:08.551823085Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-78776db7c7-hvtgq/manager/manager/logs/previous.insecure.log [must-gather-bp2wg] OUT 2026-11-03T13:49:08.551937742Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-78776db7c7-hvtgq/manager/manager/logs/previous.log [must-gather-bp2wg] OUT 2026-11-03T13:49:08.551978694Z namespaces/opendatahub/policy/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552045948Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552101741Z namespaces/opendatahub/route.openshift.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552170384Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552230658Z namespaces/openshift/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552293991Z namespaces/openshift/openshift.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552359905Z namespaces/openshift/apps.openshift.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552401247Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552469861Z namespaces/openshift/apps/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552510123Z namespaces/openshift/apps/daemonsets.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552612139Z namespaces/openshift/apps/deployments.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552710004Z namespaces/openshift/apps/replicasets.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.5528168Z namespaces/openshift/apps/statefulsets.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552878344Z namespaces/openshift/autoscaling/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.552937427Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.55299031Z namespaces/openshift/batch/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553048983Z namespaces/openshift/batch/cronjobs.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553138368Z namespaces/openshift/batch/jobs.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.55317849Z namespaces/openshift/build.openshift.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553240664Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553337219Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553387722Z namespaces/openshift/core/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553442275Z namespaces/openshift/core/configmaps.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553555811Z namespaces/openshift/core/endpoints.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553642666Z namespaces/openshift/core/events.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553741251Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553856208Z namespaces/openshift/core/pods.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.553946913Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.554107402Z namespaces/openshift/core/secrets.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.554288272Z namespaces/openshift/core/services.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.554344945Z namespaces/openshift/discovery.k8s.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.554399738Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.554451251Z namespaces/openshift/image.openshift.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.554504254Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556190337Z namespaces/openshift/k8s.ovn.org/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556256761Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556361546Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556415249Z namespaces/openshift/monitoring.coreos.com/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556459762Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556530316Z namespaces/openshift/networking.k8s.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556582488Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556635591Z namespaces/openshift/policy/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556689845Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556746168Z namespaces/openshift/route.openshift.io/ [must-gather-bp2wg] OUT 2026-11-03T13:49:08.556810171Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-bp2wg] OUT 2026-11-03T13:49:08.609517136Z [must-gather-bp2wg] OUT 2026-11-03T13:49:08.609535997Z sent 1,376 bytes received 71,887 bytes 146,526.00 bytes/sec [must-gather-bp2wg] OUT 2026-11-03T13:49:08.609540587Z total size is 851,582 speedup is 11.62 [must-gather ] OUT 2026-11-03T13:49:08.675123174Z namespace/openshift-must-gather-7w7nv deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: f024a330-b7c2-49f0-ae89-fa0928b7a74d ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing