[must-gather ] OUT 2026-04-22T16:27:06.70591797Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 41492fa9-975e-494c-96f8-6f2a09d36568 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-22T16:27:06.758367021Z namespace/openshift-must-gather-wbrmb created [must-gather ] OUT 2026-04-22T16:27:06.765602156Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-6frjn created [must-gather ] OUT 2026-04-22T16:27:06.78612312Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-qr5cn] OUT 2026-04-22T16:28:07.997552702Z waiting for gather to complete [must-gather-qr5cn] OUT 2026-04-22T16:28:08.000515779Z downloading gather output [must-gather-qr5cn] OUT 2026-04-22T16:28:08.269731326Z receiving incremental file list [must-gather-qr5cn] OUT 2026-04-22T16:28:08.280587685Z ./ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.280726468Z aggregated-discovery-api.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.281279759Z aggregated-discovery-apis.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.281925781Z event-filter.html [must-gather-qr5cn] OUT 2026-04-22T16:28:08.282048454Z timestamp [must-gather-qr5cn] OUT 2026-04-22T16:28:08.282159416Z version [must-gather-qr5cn] OUT 2026-04-22T16:28:08.28601725Z namespaces/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.286034501Z namespaces/opendatahub/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.286131632Z namespaces/opendatahub/opendatahub.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.286262405Z namespaces/opendatahub/apps.openshift.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.286327166Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.286394077Z namespaces/opendatahub/apps/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.286449829Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.2865527Z namespaces/opendatahub/apps/deployments.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.286691203Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.286822366Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.286918627Z namespaces/opendatahub/autoscaling/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.286973299Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.2870397Z namespaces/opendatahub/batch/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287088961Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287188443Z namespaces/opendatahub/batch/jobs.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287241394Z namespaces/opendatahub/build.openshift.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287295535Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287387807Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287422597Z namespaces/opendatahub/core/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287466678Z namespaces/opendatahub/core/configmaps.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287610281Z namespaces/opendatahub/core/endpoints.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287694062Z namespaces/opendatahub/core/events.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287813555Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.287916357Z namespaces/opendatahub/core/pods.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288033879Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288167102Z namespaces/opendatahub/core/secrets.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288353345Z namespaces/opendatahub/core/services.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288406636Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288451257Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288506338Z namespaces/opendatahub/image.openshift.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288558709Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288634421Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288669051Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288750623Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288794324Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288832184Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288897816Z namespaces/opendatahub/networking.k8s.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288933116Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288982167Z namespaces/opendatahub/pods/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.288989418Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-tkl44/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.289035098Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-tkl44/kubeflow-trainer-controller-manager-55f5694779-tkl44.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.2891154Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-tkl44/manager/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.28912284Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-tkl44/manager/manager/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.28912737Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-tkl44/manager/manager/logs/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.289162031Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-tkl44/manager/manager/logs/current.log [must-gather-qr5cn] OUT 2026-04-22T16:28:08.289557978Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-tkl44/manager/manager/logs/previous.insecure.log [must-gather-qr5cn] OUT 2026-04-22T16:28:08.289624379Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-tkl44/manager/manager/logs/previous.log [must-gather-qr5cn] OUT 2026-04-22T16:28:08.28966331Z namespaces/opendatahub/policy/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.289700991Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.289747572Z namespaces/opendatahub/route.openshift.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.289785753Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.289831343Z namespaces/openshift/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.289899595Z namespaces/openshift/openshift.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.289954996Z namespaces/openshift/apps.openshift.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290004227Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290047158Z namespaces/openshift/apps/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290090499Z namespaces/openshift/apps/daemonsets.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290173Z namespaces/openshift/apps/deployments.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290249431Z namespaces/openshift/apps/replicasets.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290324653Z namespaces/openshift/apps/statefulsets.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290371194Z namespaces/openshift/autoscaling/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290398614Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290447345Z namespaces/openshift/batch/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290487026Z namespaces/openshift/batch/cronjobs.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290562657Z namespaces/openshift/batch/jobs.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290603748Z namespaces/openshift/build.openshift.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290643929Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290718211Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290765421Z namespaces/openshift/core/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290801872Z namespaces/openshift/core/configmaps.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290919804Z namespaces/openshift/core/endpoints.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.290991986Z namespaces/openshift/core/events.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.291066647Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.291144969Z namespaces/openshift/core/pods.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.29121471Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.291337972Z namespaces/openshift/core/secrets.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.291503816Z namespaces/openshift/core/services.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.291550827Z namespaces/openshift/discovery.k8s.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.291578507Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.291634138Z namespaces/openshift/image.openshift.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.291671399Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293200778Z namespaces/openshift/k8s.ovn.org/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293231229Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293315621Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293347311Z namespaces/openshift/monitoring.coreos.com/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293397832Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293448313Z namespaces/openshift/networking.k8s.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293480574Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293525305Z namespaces/openshift/policy/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293567055Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293608386Z namespaces/openshift/route.openshift.io/ [must-gather-qr5cn] OUT 2026-04-22T16:28:08.293654217Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-qr5cn] OUT 2026-04-22T16:28:08.299697274Z [must-gather-qr5cn] OUT 2026-04-22T16:28:08.299718974Z sent 1,372 bytes received 76,185 bytes 155,114.00 bytes/sec [must-gather-qr5cn] OUT 2026-04-22T16:28:08.299729414Z total size is 910,652 speedup is 11.74 [must-gather ] OUT 2026-04-22T16:28:08.330901425Z namespace/openshift-must-gather-wbrmb deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 41492fa9-975e-494c-96f8-6f2a09d36568 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing