[must-gather ] OUT 2026-07-16T12:43:16.534483016Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 9b99a25b-d067-48ff-821f-b71b3c5ee217 ClientVersion: 4.22.3 ClusterVersion: Stable at "4.21.24" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-16T12:43:16.592046237Z namespace/openshift-must-gather-w92wc created [must-gather ] OUT 2026-07-16T12:43:16.597396872Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-7rsn2 created [must-gather ] OUT 2026-07-16T12:43:16.625701912Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-z9vq7] OUT 2026-07-16T12:44:13.848145136Z waiting for gather to complete [must-gather-z9vq7] OUT 2026-07-16T12:44:13.854402399Z downloading gather output [must-gather-z9vq7] OUT 2026-07-16T12:44:14.253977905Z receiving incremental file list [must-gather-z9vq7] OUT 2026-07-16T12:44:14.274599038Z ./ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.274709901Z aggregated-discovery-api.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.275311835Z aggregated-discovery-apis.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.276084322Z event-filter.html [must-gather-z9vq7] OUT 2026-07-16T12:44:14.276195065Z timestamp [must-gather-z9vq7] OUT 2026-07-16T12:44:14.276302307Z version [must-gather-z9vq7] OUT 2026-07-16T12:44:14.281765232Z namespaces/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.281808024Z namespaces/opendatahub/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.281876555Z namespaces/opendatahub/opendatahub.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.282053699Z namespaces/opendatahub/apps.openshift.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28210068Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.282282784Z namespaces/opendatahub/apps/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.282375117Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.282653953Z namespaces/opendatahub/apps/deployments.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.282877868Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.282990951Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283033261Z namespaces/opendatahub/autoscaling/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283069453Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283129814Z namespaces/opendatahub/batch/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283165805Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283246266Z namespaces/opendatahub/batch/jobs.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283290698Z namespaces/opendatahub/build.openshift.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283321478Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28341281Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283463611Z namespaces/opendatahub/core/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283503612Z namespaces/opendatahub/core/configmaps.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283628895Z namespaces/opendatahub/core/endpoints.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283729957Z namespaces/opendatahub/core/events.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28385293Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.283930292Z namespaces/opendatahub/core/pods.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284058755Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284181318Z namespaces/opendatahub/core/secrets.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284367002Z namespaces/opendatahub/core/services.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284422784Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284464984Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284520246Z namespaces/opendatahub/image.openshift.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284562767Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284660959Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28469722Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284800122Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284842383Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284885644Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284929905Z namespaces/opendatahub/networking.k8s.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.284967386Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.285013797Z namespaces/opendatahub/pods/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.285022797Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-6c6f775dbf-8b5z4/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.285063038Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-6c6f775dbf-8b5z4/kubeflow-trainer-controller-manager-6c6f775dbf-8b5z4.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28514113Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-6c6f775dbf-8b5z4/manager/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28514814Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-6c6f775dbf-8b5z4/manager/manager/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28515251Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-6c6f775dbf-8b5z4/manager/manager/logs/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.285186581Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-6c6f775dbf-8b5z4/manager/manager/logs/current.log [must-gather-z9vq7] OUT 2026-07-16T12:44:14.286940571Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-6c6f775dbf-8b5z4/manager/manager/logs/previous.insecure.log [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287007653Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-6c6f775dbf-8b5z4/manager/manager/logs/previous.log [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287045344Z namespaces/opendatahub/policy/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287081894Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287132076Z namespaces/opendatahub/route.openshift.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287170196Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287237288Z namespaces/openshift/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287281149Z namespaces/openshift/openshift.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28733484Z namespaces/openshift/apps.openshift.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287375041Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287421212Z namespaces/openshift/apps/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287465843Z namespaces/openshift/apps/daemonsets.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287548845Z namespaces/openshift/apps/deployments.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287621717Z namespaces/openshift/apps/replicasets.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287698639Z namespaces/openshift/apps/statefulsets.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28774016Z namespaces/openshift/autoscaling/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287797381Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287844612Z namespaces/openshift/batch/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287863592Z namespaces/openshift/batch/cronjobs.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287956845Z namespaces/openshift/batch/jobs.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.287998086Z namespaces/openshift/build.openshift.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288029896Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288118548Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288160939Z namespaces/openshift/core/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28819046Z namespaces/openshift/core/configmaps.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288301953Z namespaces/openshift/core/endpoints.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288374034Z namespaces/openshift/core/events.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288453246Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288526728Z namespaces/openshift/core/pods.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28860554Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288737163Z namespaces/openshift/core/secrets.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288906926Z namespaces/openshift/core/services.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288955477Z namespaces/openshift/discovery.k8s.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.288992418Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.289045019Z namespaces/openshift/image.openshift.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.28907775Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.290561804Z namespaces/openshift/k8s.ovn.org/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.290604365Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.290685837Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.290745889Z namespaces/openshift/monitoring.coreos.com/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.29079293Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.29083174Z namespaces/openshift/networking.k8s.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.290867441Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.290915762Z namespaces/openshift/policy/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.290942263Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.290996914Z namespaces/openshift/route.openshift.io/ [must-gather-z9vq7] OUT 2026-07-16T12:44:14.291037505Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-z9vq7] OUT 2026-07-16T12:44:14.300003871Z [must-gather-z9vq7] OUT 2026-07-16T12:44:14.300027862Z sent 1,380 bytes received 98,997 bytes 66,918.00 bytes/sec [must-gather-z9vq7] OUT 2026-07-16T12:44:14.300036222Z total size is 1,272,563 speedup is 12.68 [must-gather ] OUT 2026-07-16T12:44:14.334211535Z namespace/openshift-must-gather-w92wc deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 9b99a25b-d067-48ff-821f-b71b3c5ee217 ClientVersion: 4.22.3 ClusterVersion: Stable at "4.21.24" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing