[must-gather ] OUT 2026-11-12T18:40:00.611227046Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: d3369aee-3bcd-4d5c-ba1e-5a0408193d5f ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.22" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-11-12T18:40:00.747306472Z namespace/openshift-must-gather-fx2z5 created [must-gather ] OUT 2026-11-12T18:40:00.766996609Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-gp56k created [must-gather ] OUT 2026-11-12T18:40:00.841851972Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-sw4j2] OUT 2026-11-12T18:43:23.542003835Z waiting for gather to complete [must-gather-sw4j2] OUT 2026-11-12T18:43:23.557857056Z downloading gather output [must-gather-sw4j2] OUT 2026-11-12T18:43:24.524142191Z receiving incremental file list [must-gather-sw4j2] OUT 2026-11-12T18:43:24.704839858Z ./ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.70492364Z aggregated-discovery-api.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.70531492Z aggregated-discovery-apis.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.719266865Z event-filter.html [must-gather-sw4j2] OUT 2026-11-12T18:43:24.719401259Z timestamp [must-gather-sw4j2] OUT 2026-11-12T18:43:24.719524962Z version [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754008361Z namespaces/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754030812Z namespaces/openshift/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754136444Z namespaces/openshift/openshift.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754255017Z namespaces/openshift/apps.openshift.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754332569Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754422741Z namespaces/openshift/apps/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754505663Z namespaces/openshift/apps/daemonsets.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754627666Z namespaces/openshift/apps/deployments.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754736549Z namespaces/openshift/apps/replicasets.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754876472Z namespaces/openshift/apps/statefulsets.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.754931603Z namespaces/openshift/autoscaling/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.755009585Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.755085247Z namespaces/openshift/batch/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.755144768Z namespaces/openshift/batch/cronjobs.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.755265601Z namespaces/openshift/batch/jobs.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.755332813Z namespaces/openshift/build.openshift.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.755391905Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.755491177Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.755569059Z namespaces/openshift/core/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.75562651Z namespaces/openshift/core/configmaps.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.755821075Z namespaces/openshift/core/endpoints.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.756008049Z namespaces/openshift/core/events.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.756132022Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.756245135Z namespaces/openshift/core/pods.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.756362458Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.756526732Z namespaces/openshift/core/secrets.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.756729317Z namespaces/openshift/core/services.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.756820679Z namespaces/openshift/discovery.k8s.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.75688735Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.756945932Z namespaces/openshift/image.openshift.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.757002343Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.769981065Z namespaces/openshift/k8s.ovn.org/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770045007Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.77017357Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770240452Z namespaces/openshift/monitoring.coreos.com/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770300703Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770366835Z namespaces/openshift/networking.k8s.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770432656Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770496088Z namespaces/openshift/policy/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.77056959Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770637121Z namespaces/openshift/route.openshift.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770693282Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770785355Z namespaces/redhat-ods-applications/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770846436Z namespaces/redhat-ods-applications/redhat-ods-applications.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.770934158Z namespaces/redhat-ods-applications/apps.openshift.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.77099711Z namespaces/redhat-ods-applications/apps.openshift.io/deploymentconfigs.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.771067662Z namespaces/redhat-ods-applications/apps/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.771131763Z namespaces/redhat-ods-applications/apps/daemonsets.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.771266426Z namespaces/redhat-ods-applications/apps/deployments.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.771418Z namespaces/redhat-ods-applications/apps/replicasets.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.771568994Z namespaces/redhat-ods-applications/apps/statefulsets.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.771638385Z namespaces/redhat-ods-applications/autoscaling/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.771703237Z namespaces/redhat-ods-applications/autoscaling/horizontalpodautoscalers.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.771778049Z namespaces/redhat-ods-applications/batch/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.77184722Z namespaces/redhat-ods-applications/batch/cronjobs.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.771968853Z namespaces/redhat-ods-applications/batch/jobs.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.772033345Z namespaces/redhat-ods-applications/build.openshift.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.772098716Z namespaces/redhat-ods-applications/build.openshift.io/buildconfigs.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.772223699Z namespaces/redhat-ods-applications/build.openshift.io/builds.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.772291131Z namespaces/redhat-ods-applications/core/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.772359202Z namespaces/redhat-ods-applications/core/configmaps.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.772518186Z namespaces/redhat-ods-applications/core/endpoints.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.772641249Z namespaces/redhat-ods-applications/core/events.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.772825464Z namespaces/redhat-ods-applications/core/persistentvolumeclaims.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.772941356Z namespaces/redhat-ods-applications/core/pods.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.773116171Z namespaces/redhat-ods-applications/core/replicationcontrollers.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.773285115Z namespaces/redhat-ods-applications/core/secrets.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.77351951Z namespaces/redhat-ods-applications/core/services.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.773596612Z namespaces/redhat-ods-applications/discovery.k8s.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.773663264Z namespaces/redhat-ods-applications/discovery.k8s.io/endpointslices.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.773742656Z namespaces/redhat-ods-applications/image.openshift.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.773822088Z namespaces/redhat-ods-applications/image.openshift.io/imagestreams.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.773968951Z namespaces/redhat-ods-applications/k8s.ovn.org/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774028423Z namespaces/redhat-ods-applications/k8s.ovn.org/egressfirewalls.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774155796Z namespaces/redhat-ods-applications/k8s.ovn.org/egressqoses.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774222117Z namespaces/redhat-ods-applications/monitoring.coreos.com/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774277209Z namespaces/redhat-ods-applications/monitoring.coreos.com/servicemonitors.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774368171Z namespaces/redhat-ods-applications/networking.k8s.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774503424Z namespaces/redhat-ods-applications/networking.k8s.io/networkpolicies.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774580406Z namespaces/redhat-ods-applications/pods/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774588546Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-x8pzn/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774650268Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-x8pzn/kubeflow-trainer-controller-manager-79f7d5b57-x8pzn.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774803081Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-x8pzn/manager/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774822542Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-x8pzn/manager/manager/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774829942Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-x8pzn/manager/manager/logs/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.774864753Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-x8pzn/manager/manager/logs/current.log [must-gather-sw4j2] OUT 2026-11-12T18:43:24.775118509Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-x8pzn/manager/manager/logs/previous.insecure.log [must-gather-sw4j2] OUT 2026-11-12T18:43:24.775225271Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-x8pzn/manager/manager/logs/previous.log [must-gather-sw4j2] OUT 2026-11-12T18:43:24.775287733Z namespaces/redhat-ods-applications/policy/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.775355835Z namespaces/redhat-ods-applications/policy/poddisruptionbudgets.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.775419896Z namespaces/redhat-ods-applications/route.openshift.io/ [must-gather-sw4j2] OUT 2026-11-12T18:43:24.775488198Z namespaces/redhat-ods-applications/route.openshift.io/routes.yaml [must-gather-sw4j2] OUT 2026-11-12T18:43:24.905497805Z [must-gather-sw4j2] OUT 2026-11-12T18:43:24.905526426Z sent 1,380 bytes received 75,025 bytes 50,936.67 bytes/sec [must-gather-sw4j2] OUT 2026-11-12T18:43:24.905532756Z total size is 885,172 speedup is 11.59 [must-gather ] OUT 2026-11-12T18:43:25.007651273Z namespace/openshift-must-gather-fx2z5 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: d3369aee-3bcd-4d5c-ba1e-5a0408193d5f ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.22" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing