[must-gather ] OUT 2026-11-02T22:20:18.683680211Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 977f0f9f-9fd6-4e82-b575-ca9f9560bb79 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-11-02T22:20:18.797753177Z namespace/openshift-must-gather-7q7ck created [must-gather ] OUT 2026-11-02T22:20:18.813166388Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-6rqqs created [must-gather ] OUT 2026-11-02T22:20:18.847908499Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-nplx8] OUT 2026-11-02T22:23:40.340524881Z waiting for gather to complete [must-gather-nplx8] OUT 2026-11-02T22:23:40.353650858Z downloading gather output [must-gather-nplx8] OUT 2026-11-02T22:23:41.360303495Z receiving incremental file list [must-gather-nplx8] OUT 2026-11-02T22:23:41.531652923Z ./ [must-gather-nplx8] OUT 2026-11-02T22:23:41.531862678Z aggregated-discovery-api.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.532271239Z aggregated-discovery-apis.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.532921565Z event-filter.html [must-gather-nplx8] OUT 2026-11-02T22:23:41.533039908Z timestamp [must-gather-nplx8] OUT 2026-11-02T22:23:41.545855827Z version [must-gather-nplx8] OUT 2026-11-02T22:23:41.580049425Z namespaces/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.580072865Z namespaces/openshift/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.58025388Z namespaces/openshift/openshift.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.580504007Z namespaces/openshift/apps.openshift.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.58063738Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.580790864Z namespaces/openshift/apps/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.580921547Z namespaces/openshift/apps/daemonsets.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.581163993Z namespaces/openshift/apps/deployments.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.581447881Z namespaces/openshift/apps/replicasets.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.581614195Z namespaces/openshift/apps/statefulsets.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.581663216Z namespaces/openshift/autoscaling/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.581728678Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.581780869Z namespaces/openshift/batch/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.581846761Z namespaces/openshift/batch/cronjobs.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.581953454Z namespaces/openshift/batch/jobs.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.581995635Z namespaces/openshift/build.openshift.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.582058067Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.582150869Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.582223431Z namespaces/openshift/core/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.582283682Z namespaces/openshift/core/configmaps.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.582464667Z namespaces/openshift/core/endpoints.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.582559359Z namespaces/openshift/core/events.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.582669492Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.582773085Z namespaces/openshift/core/pods.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.582867717Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.583025741Z namespaces/openshift/core/secrets.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.583212576Z namespaces/openshift/core/services.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.583269338Z namespaces/openshift/discovery.k8s.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.583336149Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.583412651Z namespaces/openshift/image.openshift.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.583468443Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.596703072Z namespaces/openshift/k8s.ovn.org/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.596745904Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.596860116Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.596909118Z namespaces/openshift/monitoring.coreos.com/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.596970589Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.597026381Z namespaces/openshift/networking.k8s.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.597088702Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.597137003Z namespaces/openshift/policy/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.597196545Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.597252977Z namespaces/openshift/route.openshift.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.597313558Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.597413601Z namespaces/redhat-ods-applications/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.597476292Z namespaces/redhat-ods-applications/redhat-ods-applications.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.597550234Z namespaces/redhat-ods-applications/apps.openshift.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.597606906Z namespaces/redhat-ods-applications/apps.openshift.io/deploymentconfigs.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.597660407Z namespaces/redhat-ods-applications/apps/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.597713938Z namespaces/redhat-ods-applications/apps/daemonsets.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.597823271Z namespaces/redhat-ods-applications/apps/deployments.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.597966745Z namespaces/redhat-ods-applications/apps/replicasets.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.598098848Z namespaces/redhat-ods-applications/apps/statefulsets.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.598148809Z namespaces/redhat-ods-applications/autoscaling/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.598195701Z namespaces/redhat-ods-applications/autoscaling/horizontalpodautoscalers.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.598261932Z namespaces/redhat-ods-applications/batch/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.598313224Z namespaces/redhat-ods-applications/batch/cronjobs.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.598439977Z namespaces/redhat-ods-applications/batch/jobs.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.598488048Z namespaces/redhat-ods-applications/build.openshift.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.598533249Z namespaces/redhat-ods-applications/build.openshift.io/buildconfigs.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.598644722Z namespaces/redhat-ods-applications/build.openshift.io/builds.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.598696403Z namespaces/redhat-ods-applications/core/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.598758305Z namespaces/redhat-ods-applications/core/configmaps.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.598893539Z namespaces/redhat-ods-applications/core/endpoints.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.599007762Z namespaces/redhat-ods-applications/core/events.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.599154925Z namespaces/redhat-ods-applications/core/persistentvolumeclaims.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.599261488Z namespaces/redhat-ods-applications/core/pods.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.599427032Z namespaces/redhat-ods-applications/core/replicationcontrollers.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.599571406Z namespaces/redhat-ods-applications/core/secrets.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.599770881Z namespaces/redhat-ods-applications/core/services.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.599838753Z namespaces/redhat-ods-applications/discovery.k8s.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.599900674Z namespaces/redhat-ods-applications/discovery.k8s.io/endpointslices.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.599958626Z namespaces/redhat-ods-applications/image.openshift.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.600010337Z namespaces/redhat-ods-applications/image.openshift.io/imagestreams.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.600140611Z namespaces/redhat-ods-applications/k8s.ovn.org/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.600193042Z namespaces/redhat-ods-applications/k8s.ovn.org/egressfirewalls.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.600296824Z namespaces/redhat-ods-applications/k8s.ovn.org/egressqoses.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.600365946Z namespaces/redhat-ods-applications/monitoring.coreos.com/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.600423538Z namespaces/redhat-ods-applications/monitoring.coreos.com/servicemonitors.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.6004885Z namespaces/redhat-ods-applications/networking.k8s.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.600536981Z namespaces/redhat-ods-applications/networking.k8s.io/networkpolicies.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.600597822Z namespaces/redhat-ods-applications/pods/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.600611143Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-x2rbp/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.600658954Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-x2rbp/kubeflow-trainer-controller-manager-7d54ccd8d5-x2rbp.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.600761436Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-x2rbp/manager/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.600770547Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-x2rbp/manager/manager/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.600775917Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-x2rbp/manager/manager/logs/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.600828348Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-x2rbp/manager/manager/logs/current.log [must-gather-nplx8] OUT 2026-11-02T22:23:41.625227544Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-x2rbp/manager/manager/logs/previous.log [must-gather-nplx8] OUT 2026-11-02T22:23:41.625392329Z namespaces/redhat-ods-applications/policy/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.62544974Z namespaces/redhat-ods-applications/policy/poddisruptionbudgets.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.625514312Z namespaces/redhat-ods-applications/route.openshift.io/ [must-gather-nplx8] OUT 2026-11-02T22:23:41.625570853Z namespaces/redhat-ods-applications/route.openshift.io/routes.yaml [must-gather-nplx8] OUT 2026-11-02T22:23:41.750310515Z [must-gather-nplx8] OUT 2026-11-02T22:23:41.750367666Z sent 1,361 bytes received 123,214 bytes 83,050.00 bytes/sec [must-gather-nplx8] OUT 2026-11-02T22:23:41.750383787Z total size is 1,561,038 speedup is 12.53 [must-gather ] OUT 2026-11-02T22:23:41.849611494Z namespace/openshift-must-gather-7q7ck deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 977f0f9f-9fd6-4e82-b575-ca9f9560bb79 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing