[must-gather ] OUT 2026-11-02T22:13:58.909902543Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 825318d4-4dc5-46a9-8969-06ce14704f89 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-11-02T22:13:59.033748355Z namespace/openshift-must-gather-q7cgf created [must-gather ] OUT 2026-11-02T22:13:59.05247935Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-8q5zd created [must-gather ] OUT 2026-11-02T22:13:59.095176569Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-xmkk2] OUT 2026-11-02T22:18:45.048722926Z waiting for gather to complete [must-gather-xmkk2] OUT 2026-11-02T22:18:45.06213947Z downloading gather output [must-gather-xmkk2] OUT 2026-11-02T22:18:46.091050288Z receiving incremental file list [must-gather-xmkk2] OUT 2026-11-02T22:18:46.26769316Z ./ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.267867324Z aggregated-discovery-api.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.268616914Z aggregated-discovery-apis.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.269401664Z event-filter.html [must-gather-xmkk2] OUT 2026-11-02T22:18:46.269508647Z timestamp [must-gather-xmkk2] OUT 2026-11-02T22:18:46.279718728Z version [must-gather-xmkk2] OUT 2026-11-02T22:18:46.316789799Z namespaces/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.316857871Z namespaces/openshift/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.317016955Z namespaces/openshift/openshift.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.317251811Z namespaces/openshift/apps.openshift.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.317446296Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.317476057Z namespaces/openshift/apps/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.317559389Z namespaces/openshift/apps/daemonsets.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.317659162Z namespaces/openshift/apps/deployments.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.317757384Z namespaces/openshift/apps/replicasets.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.317851167Z namespaces/openshift/apps/statefulsets.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.317904608Z namespaces/openshift/autoscaling/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.31798819Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318040432Z namespaces/openshift/batch/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318092533Z namespaces/openshift/batch/cronjobs.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318197986Z namespaces/openshift/batch/jobs.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318245867Z namespaces/openshift/build.openshift.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318298288Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318418951Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318477603Z namespaces/openshift/core/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318530664Z namespaces/openshift/core/configmaps.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318691418Z namespaces/openshift/core/endpoints.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318791121Z namespaces/openshift/core/events.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318891973Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.318989326Z namespaces/openshift/core/pods.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.319085229Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.319235392Z namespaces/openshift/core/secrets.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.319441458Z namespaces/openshift/core/services.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.319500719Z namespaces/openshift/discovery.k8s.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.319565941Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.319616412Z namespaces/openshift/image.openshift.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.319685374Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330139362Z namespaces/openshift/k8s.ovn.org/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330180513Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330310006Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330412339Z namespaces/openshift/monitoring.coreos.com/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.33044641Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330500561Z namespaces/openshift/networking.k8s.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330537622Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330635635Z namespaces/openshift/policy/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330658675Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330723477Z namespaces/openshift/route.openshift.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330782829Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.33082597Z namespaces/redhat-ods-applications/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330890831Z namespaces/redhat-ods-applications/redhat-ods-applications.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.330970963Z namespaces/redhat-ods-applications/apps.openshift.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331025005Z namespaces/redhat-ods-applications/apps.openshift.io/deploymentconfigs.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331136728Z namespaces/redhat-ods-applications/apps/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331170179Z namespaces/redhat-ods-applications/apps/daemonsets.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331269911Z namespaces/redhat-ods-applications/apps/deployments.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331429345Z namespaces/redhat-ods-applications/apps/replicasets.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331550688Z namespaces/redhat-ods-applications/apps/statefulsets.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331589389Z namespaces/redhat-ods-applications/autoscaling/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331653901Z namespaces/redhat-ods-applications/autoscaling/horizontalpodautoscalers.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331710172Z namespaces/redhat-ods-applications/batch/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331763794Z namespaces/redhat-ods-applications/batch/cronjobs.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331864006Z namespaces/redhat-ods-applications/batch/jobs.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331907438Z namespaces/redhat-ods-applications/build.openshift.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.331969469Z namespaces/redhat-ods-applications/build.openshift.io/buildconfigs.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.332067062Z namespaces/redhat-ods-applications/build.openshift.io/builds.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.332110133Z namespaces/redhat-ods-applications/core/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.332153254Z namespaces/redhat-ods-applications/core/configmaps.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.332301268Z namespaces/redhat-ods-applications/core/endpoints.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.332433561Z namespaces/redhat-ods-applications/core/events.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.332579855Z namespaces/redhat-ods-applications/core/persistentvolumeclaims.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.332675067Z namespaces/redhat-ods-applications/core/pods.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.332809781Z namespaces/redhat-ods-applications/core/replicationcontrollers.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.332955024Z namespaces/redhat-ods-applications/core/secrets.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.33316213Z namespaces/redhat-ods-applications/core/services.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333232361Z namespaces/redhat-ods-applications/discovery.k8s.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333289253Z namespaces/redhat-ods-applications/discovery.k8s.io/endpointslices.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333403186Z namespaces/redhat-ods-applications/image.openshift.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333451277Z namespaces/redhat-ods-applications/image.openshift.io/imagestreams.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333533449Z namespaces/redhat-ods-applications/k8s.ovn.org/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.33357972Z namespaces/redhat-ods-applications/k8s.ovn.org/egressfirewalls.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333691113Z namespaces/redhat-ods-applications/k8s.ovn.org/egressqoses.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333737484Z namespaces/redhat-ods-applications/monitoring.coreos.com/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333795266Z namespaces/redhat-ods-applications/monitoring.coreos.com/servicemonitors.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333860568Z namespaces/redhat-ods-applications/networking.k8s.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333883438Z namespaces/redhat-ods-applications/networking.k8s.io/networkpolicies.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333975791Z namespaces/redhat-ods-applications/pods/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.333991161Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-7zlfc/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.334054353Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-7zlfc/kubeflow-trainer-controller-manager-7d54ccd8d5-7zlfc.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.334147025Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-7zlfc/manager/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.334168856Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-7zlfc/manager/manager/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.334178906Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-7zlfc/manager/manager/logs/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.334195296Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-7zlfc/manager/manager/logs/current.log [must-gather-xmkk2] OUT 2026-11-02T22:18:46.368293591Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-7zlfc/manager/manager/logs/previous.insecure.log [must-gather-xmkk2] OUT 2026-11-02T22:18:46.368400894Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-7d54ccd8d5-7zlfc/manager/manager/logs/previous.log [must-gather-xmkk2] OUT 2026-11-02T22:18:46.368452105Z namespaces/redhat-ods-applications/policy/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.368519027Z namespaces/redhat-ods-applications/policy/poddisruptionbudgets.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.368572788Z namespaces/redhat-ods-applications/route.openshift.io/ [must-gather-xmkk2] OUT 2026-11-02T22:18:46.368629829Z namespaces/redhat-ods-applications/route.openshift.io/routes.yaml [must-gather-xmkk2] OUT 2026-11-02T22:18:46.495399052Z [must-gather-xmkk2] OUT 2026-11-02T22:18:46.495473194Z sent 1,380 bytes received 118,555 bytes 79,956.67 bytes/sec [must-gather-xmkk2] OUT 2026-11-02T22:18:46.495507795Z total size is 1,507,737 speedup is 12.57 [must-gather ] OUT 2026-11-02T22:18:46.598494827Z namespace/openshift-must-gather-q7cgf deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 825318d4-4dc5-46a9-8969-06ce14704f89 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing