[must-gather ] OUT 2026-11-03T13:44:37.709726708Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 22166799-847e-4da2-97f4-5d95efa6e6df ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-11-03T13:44:37.86511547Z namespace/openshift-must-gather-tmgcx created [must-gather ] OUT 2026-11-03T13:44:37.885925183Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-zg4q4 created [must-gather ] OUT 2026-11-03T13:44:37.959999323Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-tt4gt] OUT 2026-11-03T13:47:57.111805736Z waiting for gather to complete [must-gather-tt4gt] OUT 2026-11-03T13:47:57.12823622Z downloading gather output [must-gather-tt4gt] OUT 2026-11-03T13:47:58.120200269Z receiving incremental file list [must-gather-tt4gt] OUT 2026-11-03T13:47:58.302117846Z ./ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.302195118Z aggregated-discovery-api.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.302566477Z aggregated-discovery-apis.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.303277145Z event-filter.html [must-gather-tt4gt] OUT 2026-11-03T13:47:58.303408368Z timestamp [must-gather-tt4gt] OUT 2026-11-03T13:47:58.314401765Z version [must-gather-tt4gt] OUT 2026-11-03T13:47:58.40203317Z namespaces/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.402079801Z namespaces/opendatahub/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.402216114Z namespaces/opendatahub/opendatahub.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.402332517Z namespaces/opendatahub/apps.openshift.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.402392189Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.402463291Z namespaces/opendatahub/apps/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.402526712Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.402641755Z namespaces/opendatahub/apps/deployments.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.402804229Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.402985114Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.403054886Z namespaces/opendatahub/autoscaling/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.403111717Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.403174209Z namespaces/opendatahub/batch/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.40322063Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.403320172Z namespaces/opendatahub/batch/jobs.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.403369434Z namespaces/opendatahub/build.openshift.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.403421505Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.403512517Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.403547728Z namespaces/opendatahub/core/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.4036117Z namespaces/opendatahub/core/configmaps.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.403763133Z namespaces/opendatahub/core/endpoints.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.403871776Z namespaces/opendatahub/core/events.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.404026Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.404119752Z namespaces/opendatahub/core/pods.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.404259176Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.404396589Z namespaces/opendatahub/core/secrets.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.404585784Z namespaces/opendatahub/core/services.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.404656566Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.404702797Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.404754848Z namespaces/opendatahub/image.openshift.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.40481079Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.4143763Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.414416041Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.414543145Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.414603396Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.414663818Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.41473562Z namespaces/opendatahub/networking.k8s.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.414795751Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.414882373Z namespaces/opendatahub/pods/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.414891273Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-4nwq8/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.414982826Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-4nwq8/kubeflow-trainer-controller-manager-84d6d98cc8-4nwq8.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415085158Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-4nwq8/manager/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415096329Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-4nwq8/manager/manager/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415101309Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-4nwq8/manager/manager/logs/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.41516719Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-4nwq8/manager/manager/logs/current.log [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415372605Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-4nwq8/manager/manager/logs/previous.insecure.log [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415457498Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-84d6d98cc8-4nwq8/manager/manager/logs/previous.log [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415506099Z namespaces/opendatahub/policy/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.41554962Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415606901Z namespaces/opendatahub/route.openshift.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415657853Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415711104Z namespaces/openshift/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415759845Z namespaces/openshift/openshift.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415814047Z namespaces/openshift/apps.openshift.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415858478Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.41594448Z namespaces/openshift/apps/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.415996041Z namespaces/openshift/apps/daemonsets.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416084243Z namespaces/openshift/apps/deployments.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416170505Z namespaces/openshift/apps/replicasets.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416265128Z namespaces/openshift/apps/statefulsets.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416312079Z namespaces/openshift/autoscaling/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.41636429Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416414402Z namespaces/openshift/batch/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416464413Z namespaces/openshift/batch/cronjobs.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416553875Z namespaces/openshift/batch/jobs.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416606096Z namespaces/openshift/build.openshift.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416650358Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.41674664Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416794631Z namespaces/openshift/core/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416840433Z namespaces/openshift/core/configmaps.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.416971206Z namespaces/openshift/core/endpoints.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.417058688Z namespaces/openshift/core/events.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.41715247Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.417241423Z namespaces/openshift/core/pods.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.417337625Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.417460668Z namespaces/openshift/core/secrets.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.417627562Z namespaces/openshift/core/services.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.417681204Z namespaces/openshift/discovery.k8s.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.417733875Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.417783596Z namespaces/openshift/image.openshift.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.417832667Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.450308684Z namespaces/openshift/k8s.ovn.org/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.450350526Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.450465188Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.45051982Z namespaces/openshift/monitoring.coreos.com/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.450574981Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.450612862Z namespaces/openshift/networking.k8s.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.450677944Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.450725215Z namespaces/openshift/policy/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.450778907Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.450830208Z namespaces/openshift/route.openshift.io/ [must-gather-tt4gt] OUT 2026-11-03T13:47:58.450876869Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-tt4gt] OUT 2026-11-03T13:47:58.579406643Z [must-gather-tt4gt] OUT 2026-11-03T13:47:58.579432554Z sent 1,380 bytes received 73,595 bytes 49,983.33 bytes/sec [must-gather-tt4gt] OUT 2026-11-03T13:47:58.579438554Z total size is 879,828 speedup is 11.73 [must-gather ] OUT 2026-11-03T13:47:58.682110857Z namespace/openshift-must-gather-tmgcx deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 22166799-847e-4da2-97f4-5d95efa6e6df ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing