[must-gather ] OUT 2026-04-23T09:27:03.299628111Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 254623d2-ced3-4009-b0a3-8e08a4b4a38a ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-23T09:27:03.355177183Z namespace/openshift-must-gather-2n2tr created [must-gather ] OUT 2026-04-23T09:27:03.366924448Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-lh8g8 created [must-gather ] OUT 2026-04-23T09:27:03.394106776Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-5s7gn] OUT 2026-04-23T09:27:53.621280573Z waiting for gather to complete [must-gather-5s7gn] OUT 2026-04-23T09:27:53.625074859Z downloading gather output [must-gather-5s7gn] OUT 2026-04-23T09:27:53.922537291Z receiving incremental file list [must-gather-5s7gn] OUT 2026-04-23T09:27:53.938764013Z ./ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.938931563Z aggregated-discovery-api.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.939453892Z aggregated-discovery-apis.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.940006104Z event-filter.html [must-gather-5s7gn] OUT 2026-04-23T09:27:53.94011801Z timestamp [must-gather-5s7gn] OUT 2026-04-23T09:27:53.940228516Z version [must-gather-5s7gn] OUT 2026-04-23T09:27:53.943925857Z namespaces/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.943942658Z namespaces/opendatahub/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.94398386Z namespaces/opendatahub/opendatahub.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944075135Z namespaces/opendatahub/apps.openshift.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944128618Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944190662Z namespaces/opendatahub/apps/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944244775Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944347371Z namespaces/opendatahub/apps/deployments.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944480268Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944588924Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944634277Z namespaces/opendatahub/autoscaling/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944669169Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944708761Z namespaces/opendatahub/batch/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944776475Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.94485975Z namespaces/opendatahub/batch/jobs.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944896422Z namespaces/opendatahub/build.openshift.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.944939494Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.945018499Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.945059761Z namespaces/opendatahub/core/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.945097603Z namespaces/opendatahub/core/configmaps.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.94522328Z namespaces/opendatahub/core/endpoints.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.945305745Z namespaces/opendatahub/core/events.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.945426072Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.945500606Z namespaces/opendatahub/core/pods.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.945636264Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.945779622Z namespaces/opendatahub/core/secrets.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.945952932Z namespaces/opendatahub/core/services.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946007715Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946042607Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946115311Z namespaces/opendatahub/image.openshift.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946148483Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946246029Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.94626995Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946354125Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946395067Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946432029Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946480962Z namespaces/opendatahub/networking.k8s.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946519104Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946563296Z namespaces/opendatahub/pods/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946573087Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-gg5zb/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.94662958Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-gg5zb/kubeflow-trainer-controller-manager-55f5694779-gg5zb.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946702984Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-gg5zb/manager/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946732576Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-gg5zb/manager/manager/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946742737Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-gg5zb/manager/manager/logs/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.946763168Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-gg5zb/manager/manager/logs/current.log [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947089157Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-gg5zb/manager/manager/logs/previous.insecure.log [must-gather-5s7gn] OUT 2026-04-23T09:27:53.9471517Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-gg5zb/manager/manager/logs/previous.log [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947183012Z namespaces/opendatahub/policy/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947225864Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947275337Z namespaces/opendatahub/route.openshift.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947317519Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947356352Z namespaces/openshift/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947397124Z namespaces/openshift/openshift.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947451937Z namespaces/openshift/apps.openshift.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947493649Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947550823Z namespaces/openshift/apps/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947578764Z namespaces/openshift/apps/daemonsets.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947660989Z namespaces/openshift/apps/deployments.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947763455Z namespaces/openshift/apps/replicasets.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947836079Z namespaces/openshift/apps/statefulsets.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947883551Z namespaces/openshift/autoscaling/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947923104Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.947963696Z namespaces/openshift/batch/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948001238Z namespaces/openshift/batch/cronjobs.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948079943Z namespaces/openshift/batch/jobs.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948125945Z namespaces/openshift/build.openshift.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948160387Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948242712Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948285094Z namespaces/openshift/core/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948323236Z namespaces/openshift/core/configmaps.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948416892Z namespaces/openshift/core/endpoints.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948495426Z namespaces/openshift/core/events.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.94857109Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948657226Z namespaces/openshift/core/pods.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.94874548Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.948866727Z namespaces/openshift/core/secrets.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.949026936Z namespaces/openshift/core/services.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.949076169Z namespaces/openshift/discovery.k8s.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.949118932Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.949159584Z namespaces/openshift/image.openshift.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.949201526Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.950739254Z namespaces/openshift/k8s.ovn.org/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.950783916Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.950867521Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.950908854Z namespaces/openshift/monitoring.coreos.com/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.950949056Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.950998139Z namespaces/openshift/networking.k8s.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.951039141Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.951086953Z namespaces/openshift/policy/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.951130296Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.951172538Z namespaces/openshift/route.openshift.io/ [must-gather-5s7gn] OUT 2026-04-23T09:27:53.951212681Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-5s7gn] OUT 2026-04-23T09:27:53.960398113Z [must-gather-5s7gn] OUT 2026-04-23T09:27:53.960419024Z sent 1,372 bytes received 75,171 bytes 153,086.00 bytes/sec [must-gather-5s7gn] OUT 2026-04-23T09:27:53.960423914Z total size is 884,988 speedup is 11.56 [must-gather ] OUT 2026-04-23T09:27:53.99186251Z namespace/openshift-must-gather-2n2tr deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 254623d2-ced3-4009-b0a3-8e08a4b4a38a ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing