[must-gather ] OUT 2026-10-30T07:55:14.479802179Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6a0e17f4-49c8-46e2-ab74-9f1b8836c86b ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-10-30T07:55:14.594555534Z namespace/openshift-must-gather-b9spw created [must-gather ] OUT 2026-10-30T07:55:14.610849233Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-fh4km created [must-gather ] OUT 2026-10-30T07:55:14.644245078Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-dr25m] OUT 2026-10-30T07:56:46.733598204Z waiting for gather to complete [must-gather-dr25m] OUT 2026-10-30T07:56:46.745516388Z downloading gather output [must-gather-dr25m] OUT 2026-10-30T07:56:47.24620277Z receiving incremental file list [must-gather-dr25m] OUT 2026-10-30T07:56:47.309794997Z ./ [must-gather-dr25m] OUT 2026-10-30T07:56:47.309875049Z aggregated-discovery-api.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.310288578Z aggregated-discovery-apis.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.311280891Z event-filter.html [must-gather-dr25m] OUT 2026-10-30T07:56:47.311409514Z timestamp [must-gather-dr25m] OUT 2026-10-30T07:56:47.321915087Z version [must-gather-dr25m] OUT 2026-10-30T07:56:47.32289982Z namespaces/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.322924Z namespaces/openshift/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.323035832Z namespaces/openshift/openshift.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.323153265Z namespaces/openshift/apps.openshift.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.323229087Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.323308539Z namespaces/openshift/apps/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.323399221Z namespaces/openshift/apps/daemonsets.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.323533804Z namespaces/openshift/apps/deployments.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.323714778Z namespaces/openshift/apps/replicasets.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.323856982Z namespaces/openshift/apps/statefulsets.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.323931933Z namespaces/openshift/autoscaling/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.324054636Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.324115957Z namespaces/openshift/batch/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.324180569Z namespaces/openshift/batch/cronjobs.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.324299202Z namespaces/openshift/batch/jobs.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.324353583Z namespaces/openshift/build.openshift.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.324423495Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.324545167Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.324634549Z namespaces/openshift/core/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.324697571Z namespaces/openshift/core/configmaps.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.324874125Z namespaces/openshift/core/endpoints.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.324996028Z namespaces/openshift/core/events.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.325126611Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.325249584Z namespaces/openshift/core/pods.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.325362976Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.32554096Z namespaces/openshift/core/secrets.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.325760135Z namespaces/openshift/core/services.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.325845327Z namespaces/openshift/discovery.k8s.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.325915139Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.325989681Z namespaces/openshift/image.openshift.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.326074673Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.337083736Z namespaces/openshift/k8s.ovn.org/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.337143688Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.337286421Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.337346593Z namespaces/openshift/monitoring.coreos.com/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.337416764Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.337465335Z namespaces/openshift/networking.k8s.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.337530507Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.337604948Z namespaces/openshift/policy/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.33768173Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.337746462Z namespaces/openshift/route.openshift.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.337819533Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.337881165Z namespaces/redhat-ods-applications/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.337949187Z namespaces/redhat-ods-applications/redhat-ods-applications.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.338040219Z namespaces/redhat-ods-applications/apps.openshift.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.33812104Z namespaces/redhat-ods-applications/apps.openshift.io/deploymentconfigs.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.338184042Z namespaces/redhat-ods-applications/apps/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.338268664Z namespaces/redhat-ods-applications/apps/daemonsets.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.338398877Z namespaces/redhat-ods-applications/apps/deployments.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.33855453Z namespaces/redhat-ods-applications/apps/replicasets.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.338771795Z namespaces/redhat-ods-applications/apps/statefulsets.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.338841677Z namespaces/redhat-ods-applications/autoscaling/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.338925979Z namespaces/redhat-ods-applications/autoscaling/horizontalpodautoscalers.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.339015161Z namespaces/redhat-ods-applications/batch/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.339498962Z namespaces/redhat-ods-applications/batch/cronjobs.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.339691167Z namespaces/redhat-ods-applications/batch/jobs.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.339751308Z namespaces/redhat-ods-applications/build.openshift.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.33981889Z namespaces/redhat-ods-applications/build.openshift.io/buildconfigs.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.339941962Z namespaces/redhat-ods-applications/build.openshift.io/builds.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.339998514Z namespaces/redhat-ods-applications/core/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.340084956Z namespaces/redhat-ods-applications/core/configmaps.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.34025674Z namespaces/redhat-ods-applications/core/endpoints.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.340423424Z namespaces/redhat-ods-applications/core/events.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.340606718Z namespaces/redhat-ods-applications/core/persistentvolumeclaims.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.34071918Z namespaces/redhat-ods-applications/core/pods.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.340875994Z namespaces/redhat-ods-applications/core/replicationcontrollers.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.341091919Z namespaces/redhat-ods-applications/core/secrets.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.341330894Z namespaces/redhat-ods-applications/core/services.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.341396466Z namespaces/redhat-ods-applications/discovery.k8s.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.341460517Z namespaces/redhat-ods-applications/discovery.k8s.io/endpointslices.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.341530139Z namespaces/redhat-ods-applications/image.openshift.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.341618651Z namespaces/redhat-ods-applications/image.openshift.io/imagestreams.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.341761015Z namespaces/redhat-ods-applications/k8s.ovn.org/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.341817276Z namespaces/redhat-ods-applications/k8s.ovn.org/egressfirewalls.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.341938949Z namespaces/redhat-ods-applications/k8s.ovn.org/egressqoses.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.34200985Z namespaces/redhat-ods-applications/monitoring.coreos.com/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.342096672Z namespaces/redhat-ods-applications/monitoring.coreos.com/servicemonitors.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.342184504Z namespaces/redhat-ods-applications/networking.k8s.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.342259136Z namespaces/redhat-ods-applications/networking.k8s.io/networkpolicies.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.342361948Z namespaces/redhat-ods-applications/pods/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.342369329Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-flwtt/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.342469241Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-flwtt/kubeflow-trainer-controller-manager-79f7d5b57-flwtt.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.342641815Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-flwtt/manager/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.342657755Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-flwtt/manager/manager/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.342663365Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-flwtt/manager/manager/logs/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.342726817Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-flwtt/manager/manager/logs/current.log [must-gather-dr25m] OUT 2026-10-30T07:56:47.350792303Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-flwtt/manager/manager/logs/previous.insecure.log [must-gather-dr25m] OUT 2026-10-30T07:56:47.350932426Z namespaces/redhat-ods-applications/pods/kubeflow-trainer-controller-manager-79f7d5b57-flwtt/manager/manager/logs/previous.log [must-gather-dr25m] OUT 2026-10-30T07:56:47.351002628Z namespaces/redhat-ods-applications/policy/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.351071589Z namespaces/redhat-ods-applications/policy/poddisruptionbudgets.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.351138951Z namespaces/redhat-ods-applications/route.openshift.io/ [must-gather-dr25m] OUT 2026-10-30T07:56:47.351217523Z namespaces/redhat-ods-applications/route.openshift.io/routes.yaml [must-gather-dr25m] OUT 2026-10-30T07:56:47.40181223Z [must-gather-dr25m] OUT 2026-10-30T07:56:47.401880911Z sent 1,380 bytes received 159,502 bytes 107,254.67 bytes/sec [must-gather-dr25m] OUT 2026-10-30T07:56:47.401891172Z total size is 2,045,916 speedup is 12.72 [must-gather ] OUT 2026-10-30T07:56:47.460131866Z namespace/openshift-must-gather-b9spw deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6a0e17f4-49c8-46e2-ab74-9f1b8836c86b ClientVersion: 4.22.15 ClusterVersion: Stable at "4.22.20" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. clusteroperator/authentication is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing