[must-gather ] OUT 2026-05-26T09:29:56.315500241Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: b24d3387-dc65-49ab-823c-b47a4c48127c ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.23" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-05-26T09:29:56.384108832Z namespace/openshift-must-gather-52x49 created [must-gather ] OUT 2026-05-26T09:29:56.393469097Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-6j5c2 created [must-gather ] OUT 2026-05-26T09:29:56.43755859Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-fhj5t] OUT 2026-05-26T09:30:54.825787921Z waiting for gather to complete [must-gather-fhj5t] OUT 2026-05-26T09:30:54.831783066Z downloading gather output [must-gather-fhj5t] OUT 2026-05-26T09:30:55.236111773Z receiving incremental file list [must-gather-fhj5t] OUT 2026-05-26T09:30:55.246075504Z ./ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.246167071Z aggregated-discovery-api.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.246476854Z aggregated-discovery-apis.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.24723989Z event-filter.html [must-gather-fhj5t] OUT 2026-05-26T09:30:55.247375261Z timestamp [must-gather-fhj5t] OUT 2026-05-26T09:30:55.247519351Z version [must-gather-fhj5t] OUT 2026-05-26T09:30:55.258362197Z namespaces/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.258386319Z namespaces/opendatahub/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.258472975Z namespaces/opendatahub/opendatahub.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.258583403Z namespaces/opendatahub/apps.openshift.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.258636887Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.258702382Z namespaces/opendatahub/apps/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.258758766Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.258861224Z namespaces/opendatahub/apps/deployments.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.259054938Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.259174467Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.259228511Z namespaces/opendatahub/autoscaling/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.259287906Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.25934441Z namespaces/opendatahub/batch/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.259401914Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.259493791Z namespaces/opendatahub/batch/jobs.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.259551415Z namespaces/opendatahub/build.openshift.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.2596117Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.259711947Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.259766731Z namespaces/opendatahub/core/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.259818475Z namespaces/opendatahub/core/configmaps.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.260004009Z namespaces/opendatahub/core/endpoints.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.260115697Z namespaces/opendatahub/core/events.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.260236266Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.260322553Z namespaces/opendatahub/core/pods.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.260450072Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.260607714Z namespaces/opendatahub/core/secrets.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.260816049Z namespaces/opendatahub/core/services.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.260885134Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.260938558Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261034916Z namespaces/opendatahub/image.openshift.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261086249Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261188787Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261241631Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261336368Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261390342Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261464368Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261515561Z namespaces/opendatahub/networking.k8s.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261571576Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.26162658Z namespaces/opendatahub/pods/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.26163305Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-57cfc69d8d-qwj8c/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261703415Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-57cfc69d8d-qwj8c/kubeflow-trainer-controller-manager-57cfc69d8d-qwj8c.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261797122Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-57cfc69d8d-qwj8c/manager/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261826224Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-57cfc69d8d-qwj8c/manager/manager/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261832115Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-57cfc69d8d-qwj8c/manager/manager/logs/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.261841896Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-57cfc69d8d-qwj8c/manager/manager/logs/current.log [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262101435Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-57cfc69d8d-qwj8c/manager/manager/logs/previous.insecure.log [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262191422Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-57cfc69d8d-qwj8c/manager/manager/logs/previous.log [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262236415Z namespaces/opendatahub/policy/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262298759Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262358964Z namespaces/opendatahub/route.openshift.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262428509Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262497144Z namespaces/openshift/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262555969Z namespaces/openshift/openshift.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262622043Z namespaces/openshift/apps.openshift.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262672757Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262735052Z namespaces/openshift/apps/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262790396Z namespaces/openshift/apps/daemonsets.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.262891554Z namespaces/openshift/apps/deployments.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263016633Z namespaces/openshift/apps/replicasets.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.26311661Z namespaces/openshift/apps/statefulsets.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263181745Z namespaces/openshift/autoscaling/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263238249Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263298404Z namespaces/openshift/batch/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263340807Z namespaces/openshift/batch/cronjobs.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263445765Z namespaces/openshift/batch/jobs.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263499869Z namespaces/openshift/build.openshift.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263561053Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263661621Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263722145Z namespaces/openshift/core/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.2637844Z namespaces/openshift/core/configmaps.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.263896548Z namespaces/openshift/core/endpoints.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.264020637Z namespaces/openshift/core/events.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.264122885Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.264219062Z namespaces/openshift/core/pods.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.264314029Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.26446024Z namespaces/openshift/core/secrets.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.264643524Z namespaces/openshift/core/services.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.264706058Z namespaces/openshift/discovery.k8s.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.264769753Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.264827337Z namespaces/openshift/image.openshift.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.264897452Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266254684Z namespaces/openshift/k8s.ovn.org/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266320208Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266435937Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266499902Z namespaces/openshift/monitoring.coreos.com/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266578777Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266625931Z namespaces/openshift/networking.k8s.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266687426Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266753281Z namespaces/openshift/policy/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266809055Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266869899Z namespaces/openshift/route.openshift.io/ [must-gather-fhj5t] OUT 2026-05-26T09:30:55.266926763Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-fhj5t] OUT 2026-05-26T09:30:55.273533714Z [must-gather-fhj5t] OUT 2026-05-26T09:30:55.273560896Z sent 1,372 bytes received 70,620 bytes 47,994.67 bytes/sec [must-gather-fhj5t] OUT 2026-05-26T09:30:55.273571127Z total size is 834,123 speedup is 11.59 [must-gather ] OUT 2026-05-26T09:30:55.306427289Z namespace/openshift-must-gather-52x49 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: b24d3387-dc65-49ab-823c-b47a4c48127c ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.23" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing