[must-gather ] OUT 2026-11-03T19:05:56.151927905Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 4866c440-9563-49ff-bbad-84f1d9c63a57 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-11-03T19:05:56.292432743Z namespace/openshift-must-gather-d8wm7 created [must-gather ] OUT 2026-11-03T19:05:56.313254058Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-75ggx created [must-gather ] OUT 2026-11-03T19:05:56.356880475Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-295sj] OUT 2026-11-03T19:06:54.036304344Z waiting for gather to complete [must-gather-295sj] OUT 2026-11-03T19:06:54.052649943Z downloading gather output [must-gather-295sj] OUT 2026-11-03T19:06:54.438869532Z receiving incremental file list [must-gather-295sj] OUT 2026-11-03T19:06:54.475876342Z ./ [must-gather-295sj] OUT 2026-11-03T19:06:54.476045766Z aggregated-discovery-api.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.476718362Z aggregated-discovery-apis.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.477344107Z event-filter.html [must-gather-295sj] OUT 2026-11-03T19:06:54.489313372Z timestamp [must-gather-295sj] OUT 2026-11-03T19:06:54.489467116Z version [must-gather-295sj] OUT 2026-11-03T19:06:54.489624379Z namespaces/ [must-gather-295sj] OUT 2026-11-03T19:06:54.48964545Z namespaces/opendatahub/ [must-gather-295sj] OUT 2026-11-03T19:06:54.489718991Z namespaces/opendatahub/opendatahub.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.489821754Z namespaces/opendatahub/apps.openshift.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.489864515Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.489933616Z namespaces/opendatahub/apps/ [must-gather-295sj] OUT 2026-11-03T19:06:54.489967377Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.49008022Z namespaces/opendatahub/apps/deployments.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.490219883Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.490348886Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.490387647Z namespaces/opendatahub/autoscaling/ [must-gather-295sj] OUT 2026-11-03T19:06:54.490456009Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.490529111Z namespaces/opendatahub/batch/ [must-gather-295sj] OUT 2026-11-03T19:06:54.490587432Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.490682874Z namespaces/opendatahub/batch/jobs.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.490735826Z namespaces/opendatahub/build.openshift.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.490790467Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.490885999Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.49093731Z namespaces/opendatahub/core/ [must-gather-295sj] OUT 2026-11-03T19:06:54.491006982Z namespaces/opendatahub/core/configmaps.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.491149276Z namespaces/opendatahub/core/endpoints.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.491248088Z namespaces/opendatahub/core/events.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.491392221Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.491484644Z namespaces/opendatahub/core/pods.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.491654128Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.491797511Z namespaces/opendatahub/core/secrets.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.491998876Z namespaces/opendatahub/core/services.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.502748552Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.502821663Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.502904755Z namespaces/opendatahub/image.openshift.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.502968817Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.503140531Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-295sj] OUT 2026-11-03T19:06:54.503196742Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.503315795Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.503378646Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-295sj] OUT 2026-11-03T19:06:54.503463998Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.50351756Z namespaces/opendatahub/networking.k8s.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.503607652Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.503679454Z namespaces/opendatahub/pods/ [must-gather-295sj] OUT 2026-11-03T19:06:54.503686784Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-75d89f4d4d-8v5md/ [must-gather-295sj] OUT 2026-11-03T19:06:54.503746565Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-75d89f4d4d-8v5md/kubeflow-trainer-controller-manager-75d89f4d4d-8v5md.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.503850828Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-75d89f4d4d-8v5md/manager/ [must-gather-295sj] OUT 2026-11-03T19:06:54.503860748Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-75d89f4d4d-8v5md/manager/manager/ [must-gather-295sj] OUT 2026-11-03T19:06:54.503865658Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-75d89f4d4d-8v5md/manager/manager/logs/ [must-gather-295sj] OUT 2026-11-03T19:06:54.503896939Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-75d89f4d4d-8v5md/manager/manager/logs/current.log [must-gather-295sj] OUT 2026-11-03T19:06:54.518713921Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-75d89f4d4d-8v5md/manager/manager/logs/previous.insecure.log [must-gather-295sj] OUT 2026-11-03T19:06:54.518804343Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-75d89f4d4d-8v5md/manager/manager/logs/previous.log [must-gather-295sj] OUT 2026-11-03T19:06:54.518856225Z namespaces/opendatahub/policy/ [must-gather-295sj] OUT 2026-11-03T19:06:54.518921796Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.518989918Z namespaces/opendatahub/route.openshift.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.519055369Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.51909844Z namespaces/openshift/ [must-gather-295sj] OUT 2026-11-03T19:06:54.519170712Z namespaces/openshift/openshift.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.519235434Z namespaces/openshift/apps.openshift.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.519280155Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.519342516Z namespaces/openshift/apps/ [must-gather-295sj] OUT 2026-11-03T19:06:54.519391057Z namespaces/openshift/apps/daemonsets.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.51948998Z namespaces/openshift/apps/deployments.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.519607662Z namespaces/openshift/apps/replicasets.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.519694404Z namespaces/openshift/apps/statefulsets.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.519749276Z namespaces/openshift/autoscaling/ [must-gather-295sj] OUT 2026-11-03T19:06:54.519800837Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.519852358Z namespaces/openshift/batch/ [must-gather-295sj] OUT 2026-11-03T19:06:54.51990613Z namespaces/openshift/batch/cronjobs.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.520006002Z namespaces/openshift/batch/jobs.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.520056323Z namespaces/openshift/build.openshift.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.520110594Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.520224817Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.520282709Z namespaces/openshift/core/ [must-gather-295sj] OUT 2026-11-03T19:06:54.52033888Z namespaces/openshift/core/configmaps.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.520456243Z namespaces/openshift/core/endpoints.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.520571235Z namespaces/openshift/core/events.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.520663367Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.5207576Z namespaces/openshift/core/pods.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.520855052Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.521001066Z namespaces/openshift/core/secrets.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.52118097Z namespaces/openshift/core/services.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.521237531Z namespaces/openshift/discovery.k8s.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.521293763Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.521337764Z namespaces/openshift/image.openshift.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.521395415Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.523139457Z namespaces/openshift/k8s.ovn.org/ [must-gather-295sj] OUT 2026-11-03T19:06:54.523186638Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.52328678Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.523335171Z namespaces/openshift/monitoring.coreos.com/ [must-gather-295sj] OUT 2026-11-03T19:06:54.523390263Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.523446374Z namespaces/openshift/networking.k8s.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.523495785Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.523568237Z namespaces/openshift/policy/ [must-gather-295sj] OUT 2026-11-03T19:06:54.523614018Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.523670149Z namespaces/openshift/route.openshift.io/ [must-gather-295sj] OUT 2026-11-03T19:06:54.523725151Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-295sj] OUT 2026-11-03T19:06:54.556676704Z [must-gather-295sj] OUT 2026-11-03T19:06:54.556702275Z sent 1,380 bytes received 174,750 bytes 352,260.00 bytes/sec [must-gather-295sj] OUT 2026-11-03T19:06:54.556727066Z total size is 2,256,689 speedup is 12.81 [must-gather ] OUT 2026-11-03T19:06:54.619797286Z namespace/openshift-must-gather-d8wm7 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 4866c440-9563-49ff-bbad-84f1d9c63a57 ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing