[must-gather ] OUT 2026-04-23T09:04:12.687108895Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 20e977c6-ba9e-4e14-9366-646510a3371c ClientVersion: 4.21.4 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-23T09:04:12.743764421Z namespace/openshift-must-gather-b45tk created [must-gather ] OUT 2026-04-23T09:04:12.751284645Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-qhzvm created [must-gather ] OUT 2026-04-23T09:04:12.774100874Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-6t6kd] OUT 2026-04-23T09:05:04.772519839Z waiting for gather to complete [must-gather-6t6kd] OUT 2026-04-23T09:05:04.775869751Z downloading gather output [must-gather-6t6kd] OUT 2026-04-23T09:05:05.052219008Z receiving incremental file list [must-gather-6t6kd] OUT 2026-04-23T09:05:05.065346078Z ./ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.065517093Z aggregated-discovery-api.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.06687881Z aggregated-discovery-apis.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.067380904Z event-filter.html [must-gather-6t6kd] OUT 2026-04-23T09:05:05.067498487Z timestamp [must-gather-6t6kd] OUT 2026-04-23T09:05:05.06760538Z version [must-gather-6t6kd] OUT 2026-04-23T09:05:05.070084308Z namespaces/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.070099018Z namespaces/opendatahub/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.070267573Z namespaces/opendatahub/opendatahub.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.070424837Z namespaces/opendatahub/apps.openshift.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.07052661Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.070651073Z namespaces/opendatahub/apps/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.070746026Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.070954352Z namespaces/opendatahub/apps/deployments.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071080205Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071212028Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071240169Z namespaces/opendatahub/autoscaling/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.07128335Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071303211Z namespaces/opendatahub/batch/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071358303Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071417134Z namespaces/opendatahub/batch/jobs.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071448605Z namespaces/opendatahub/build.openshift.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071524347Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071587719Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071607079Z namespaces/opendatahub/core/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071691742Z namespaces/opendatahub/core/configmaps.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071807665Z namespaces/opendatahub/core/endpoints.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.071878737Z namespaces/opendatahub/core/events.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.07200026Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072076742Z namespaces/opendatahub/core/pods.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072226736Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.07235324Z namespaces/opendatahub/core/secrets.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072535875Z namespaces/opendatahub/core/services.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072589306Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072643798Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072702639Z namespaces/opendatahub/image.openshift.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072748641Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072826043Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072871104Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072952486Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.072995827Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.073057539Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.07308714Z namespaces/opendatahub/networking.k8s.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.073136041Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.073201383Z namespaces/opendatahub/pods/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.073212313Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86cf4d89c5-rsc2c/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.073255884Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86cf4d89c5-rsc2c/kubeflow-trainer-controller-manager-86cf4d89c5-rsc2c.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.073340387Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86cf4d89c5-rsc2c/manager/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.073347017Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86cf4d89c5-rsc2c/manager/manager/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.073350527Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86cf4d89c5-rsc2c/manager/manager/logs/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.073388588Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86cf4d89c5-rsc2c/manager/manager/logs/current.log [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075006312Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86cf4d89c5-rsc2c/manager/manager/logs/previous.insecure.log [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075077174Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86cf4d89c5-rsc2c/manager/manager/logs/previous.log [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075111645Z namespaces/opendatahub/policy/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075156537Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075230749Z namespaces/opendatahub/route.openshift.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.07526553Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075309741Z namespaces/openshift/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075362182Z namespaces/openshift/openshift.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075407383Z namespaces/openshift/apps.openshift.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075451505Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075498266Z namespaces/openshift/apps/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075536617Z namespaces/openshift/apps/daemonsets.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075619279Z namespaces/openshift/apps/deployments.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075722492Z namespaces/openshift/apps/replicasets.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075784464Z namespaces/openshift/apps/statefulsets.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075833705Z namespaces/openshift/autoscaling/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075871526Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075916957Z namespaces/openshift/batch/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.075956158Z namespaces/openshift/batch/cronjobs.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076037231Z namespaces/openshift/batch/jobs.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076078302Z namespaces/openshift/build.openshift.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076120733Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076281727Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076323199Z namespaces/openshift/core/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.0763704Z namespaces/openshift/core/configmaps.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076476623Z namespaces/openshift/core/endpoints.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076556055Z namespaces/openshift/core/events.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076642037Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076715809Z namespaces/openshift/core/pods.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076798832Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.076917255Z namespaces/openshift/core/secrets.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.077091689Z namespaces/openshift/core/services.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.077145561Z namespaces/openshift/discovery.k8s.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.077214623Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.077253154Z namespaces/openshift/image.openshift.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.077291595Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.078704894Z namespaces/openshift/k8s.ovn.org/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.078748235Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.078834117Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.078874148Z namespaces/openshift/monitoring.coreos.com/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.078917059Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.078962841Z namespaces/openshift/networking.k8s.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.079003152Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.079050263Z namespaces/openshift/policy/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.079102355Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.079177917Z namespaces/openshift/route.openshift.io/ [must-gather-6t6kd] OUT 2026-04-23T09:05:05.079239318Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-6t6kd] OUT 2026-04-23T09:05:05.087130675Z [must-gather-6t6kd] OUT 2026-04-23T09:05:05.087147115Z sent 1,376 bytes received 103,123 bytes 69,666.00 bytes/sec [must-gather-6t6kd] OUT 2026-04-23T09:05:05.087151835Z total size is 1,346,537 speedup is 12.89 [must-gather ] OUT 2026-04-23T09:05:05.116273542Z namespace/openshift-must-gather-b45tk deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 20e977c6-ba9e-4e14-9366-646510a3371c ClientVersion: 4.21.4 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing