[must-gather ] OUT 2026-06-08T16:42:14.619417485Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 3510e3e6-23cd-48ba-bcb9-3dad4b79aa4c ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-06-08T16:42:14.672104037Z namespace/openshift-must-gather-x6vwt created [must-gather ] OUT 2026-06-08T16:42:14.680308236Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-xqnr4 created [must-gather ] OUT 2026-06-08T16:42:14.712264921Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-dl7sw] OUT 2026-06-08T16:43:14.581717219Z waiting for gather to complete [must-gather-dl7sw] OUT 2026-06-08T16:43:14.590578513Z downloading gather output [must-gather-dl7sw] OUT 2026-06-08T16:43:14.926917729Z receiving incremental file list [must-gather-dl7sw] OUT 2026-06-08T16:43:14.93870866Z ./ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.938785502Z aggregated-discovery-api.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.939100399Z aggregated-discovery-apis.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.939697643Z event-filter.html [must-gather-dl7sw] OUT 2026-06-08T16:43:14.939797695Z timestamp [must-gather-dl7sw] OUT 2026-06-08T16:43:14.939932208Z version [must-gather-dl7sw] OUT 2026-06-08T16:43:14.942787724Z namespaces/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.942800844Z namespaces/opendatahub/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.942839175Z namespaces/opendatahub/opendatahub.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.942942637Z namespaces/opendatahub/apps.openshift.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943003199Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.94306173Z namespaces/opendatahub/apps/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943115411Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943214724Z namespaces/opendatahub/apps/deployments.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943348697Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.94348096Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943530761Z namespaces/opendatahub/autoscaling/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943589322Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943637733Z namespaces/opendatahub/batch/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943688215Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943772046Z namespaces/opendatahub/batch/jobs.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943797657Z namespaces/opendatahub/build.openshift.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943865288Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.94393844Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.943990571Z namespaces/opendatahub/core/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.944026612Z namespaces/opendatahub/core/configmaps.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.944149555Z namespaces/opendatahub/core/endpoints.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.944229387Z namespaces/opendatahub/core/events.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.94436118Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.944434602Z namespaces/opendatahub/core/pods.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.944562535Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.944685178Z namespaces/opendatahub/core/secrets.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.944895142Z namespaces/opendatahub/core/services.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.944938363Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.944989285Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945047646Z namespaces/opendatahub/image.openshift.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945097447Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945203619Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.94524509Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945327292Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945371423Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945410434Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945456875Z namespaces/opendatahub/networking.k8s.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945503066Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945546817Z namespaces/opendatahub/pods/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945553917Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-s4j7f/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945596258Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-s4j7f/kubeflow-trainer-controller-manager-857f77d56c-s4j7f.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.94568337Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-s4j7f/manager/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945693841Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-s4j7f/manager/manager/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945700671Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-s4j7f/manager/manager/logs/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945726831Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-s4j7f/manager/manager/logs/current.log [must-gather-dl7sw] OUT 2026-06-08T16:43:14.945961627Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-s4j7f/manager/manager/logs/previous.insecure.log [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946028818Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-s4j7f/manager/manager/logs/previous.log [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946061299Z namespaces/opendatahub/policy/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.94609336Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946147701Z namespaces/opendatahub/route.openshift.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946201262Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946240703Z namespaces/openshift/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946283064Z namespaces/openshift/openshift.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946342076Z namespaces/openshift/apps.openshift.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946386937Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946435538Z namespaces/openshift/apps/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946461728Z namespaces/openshift/apps/daemonsets.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.94654743Z namespaces/openshift/apps/deployments.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946625172Z namespaces/openshift/apps/replicasets.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946705494Z namespaces/openshift/apps/statefulsets.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946742975Z namespaces/openshift/autoscaling/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946787236Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946835487Z namespaces/openshift/batch/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.946907578Z namespaces/openshift/batch/cronjobs.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.94697414Z namespaces/openshift/batch/jobs.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947017111Z namespaces/openshift/build.openshift.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947067222Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947147994Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947188755Z namespaces/openshift/core/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947237096Z namespaces/openshift/core/configmaps.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947336658Z namespaces/openshift/core/endpoints.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.94741202Z namespaces/openshift/core/events.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947498072Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947581454Z namespaces/openshift/core/pods.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947653866Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947779369Z namespaces/openshift/core/secrets.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.947954133Z namespaces/openshift/core/services.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.948004304Z namespaces/openshift/discovery.k8s.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.948046005Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.948093396Z namespaces/openshift/image.openshift.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.948137327Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.949668552Z namespaces/openshift/k8s.ovn.org/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.949713123Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.949789915Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.949823965Z namespaces/openshift/monitoring.coreos.com/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.949928338Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.949953948Z namespaces/openshift/networking.k8s.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.949977889Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.95002996Z namespaces/openshift/policy/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.950072051Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.950115342Z namespaces/openshift/route.openshift.io/ [must-gather-dl7sw] OUT 2026-06-08T16:43:14.950156363Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-dl7sw] OUT 2026-06-08T16:43:14.959713043Z [must-gather-dl7sw] OUT 2026-06-08T16:43:14.959735473Z sent 1,372 bytes received 70,735 bytes 144,214.00 bytes/sec [must-gather-dl7sw] OUT 2026-06-08T16:43:14.959746604Z total size is 832,198 speedup is 11.54 [must-gather ] OUT 2026-06-08T16:43:14.990561341Z namespace/openshift-must-gather-x6vwt deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 3510e3e6-23cd-48ba-bcb9-3dad4b79aa4c ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing