[must-gather ] OUT 2026-07-31T10:07:00.708401438Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 8253d403-dfb0-4440-a057-aeaf510334a5 ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-31T10:07:00.75729812Z namespace/openshift-must-gather-qxggr created [must-gather ] OUT 2026-07-31T10:07:00.761903285Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-bd6cd created [must-gather ] OUT 2026-07-31T10:07:00.785493238Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-n5jj7] OUT 2026-07-31T10:07:53.901015528Z waiting for gather to complete [must-gather-n5jj7] OUT 2026-07-31T10:07:53.904489799Z downloading gather output [must-gather-n5jj7] OUT 2026-07-31T10:07:54.175853662Z receiving incremental file list [must-gather-n5jj7] OUT 2026-07-31T10:07:54.194115372Z ./ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.194216374Z aggregated-discovery-api.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.19453849Z aggregated-discovery-apis.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.195103332Z event-filter.html [must-gather-n5jj7] OUT 2026-07-31T10:07:54.195206954Z timestamp [must-gather-n5jj7] OUT 2026-07-31T10:07:54.195316356Z version [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199049252Z namespaces/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199065192Z namespaces/opendatahub/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199116483Z namespaces/opendatahub/opendatahub.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199240365Z namespaces/opendatahub/apps.openshift.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199294097Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199343498Z namespaces/opendatahub/apps/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199402759Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199498541Z namespaces/opendatahub/apps/deployments.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199634864Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199773696Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199821887Z namespaces/opendatahub/autoscaling/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199856608Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.199912009Z namespaces/opendatahub/batch/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.19994013Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200032341Z namespaces/opendatahub/batch/jobs.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200077682Z namespaces/opendatahub/build.openshift.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200100913Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200188635Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200238906Z namespaces/opendatahub/core/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200269086Z namespaces/opendatahub/core/configmaps.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200414699Z namespaces/opendatahub/core/endpoints.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200503151Z namespaces/opendatahub/core/events.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200626704Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200730016Z namespaces/opendatahub/core/pods.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200864198Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.200994781Z namespaces/opendatahub/core/secrets.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201178105Z namespaces/opendatahub/core/services.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201240586Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201286507Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201347498Z namespaces/opendatahub/image.openshift.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201390269Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201499271Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201535652Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201617844Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201659725Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201707275Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201757687Z namespaces/opendatahub/networking.k8s.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201804588Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201835898Z namespaces/opendatahub/pods/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201845308Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-29vlr/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201896159Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-29vlr/kubeflow-trainer-controller-manager-7b4fcbc79d-29vlr.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201982411Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-29vlr/manager/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.201998261Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-29vlr/manager/manager/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202003932Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-29vlr/manager/manager/logs/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202021132Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-29vlr/manager/manager/logs/current.log [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202240066Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-29vlr/manager/manager/logs/previous.insecure.log [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202309158Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-29vlr/manager/manager/logs/previous.log [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202328278Z namespaces/opendatahub/policy/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202381889Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.20243599Z namespaces/opendatahub/route.openshift.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202460421Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202511582Z namespaces/openshift/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202534532Z namespaces/openshift/openshift.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202607664Z namespaces/openshift/apps.openshift.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202624414Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202704616Z namespaces/openshift/apps/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202754397Z namespaces/openshift/apps/daemonsets.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.202838368Z namespaces/openshift/apps/deployments.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.20292106Z namespaces/openshift/apps/replicasets.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203003032Z namespaces/openshift/apps/statefulsets.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203053403Z namespaces/openshift/autoscaling/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203083523Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203136184Z namespaces/openshift/batch/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203154515Z namespaces/openshift/batch/cronjobs.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203256787Z namespaces/openshift/batch/jobs.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203290818Z namespaces/openshift/build.openshift.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203323108Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.20341483Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203455671Z namespaces/openshift/core/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203498362Z namespaces/openshift/core/configmaps.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203597714Z namespaces/openshift/core/endpoints.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203675765Z namespaces/openshift/core/events.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203778497Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203857289Z namespaces/openshift/core/pods.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.203933291Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.204063043Z namespaces/openshift/core/secrets.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.204228977Z namespaces/openshift/core/services.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.204276718Z namespaces/openshift/discovery.k8s.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.204319848Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.204364309Z namespaces/openshift/image.openshift.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.20439775Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.206225857Z namespaces/openshift/k8s.ovn.org/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.206270028Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.206354669Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.20638618Z namespaces/openshift/monitoring.coreos.com/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.206436501Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.206470202Z namespaces/openshift/networking.k8s.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.206523843Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.206568214Z namespaces/openshift/policy/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.206580604Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.206663906Z namespaces/openshift/route.openshift.io/ [must-gather-n5jj7] OUT 2026-07-31T10:07:54.206677416Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-n5jj7] OUT 2026-07-31T10:07:54.220299092Z [must-gather-n5jj7] OUT 2026-07-31T10:07:54.220315542Z sent 1,372 bytes received 70,689 bytes 48,040.67 bytes/sec [must-gather-n5jj7] OUT 2026-07-31T10:07:54.220324612Z total size is 843,443 speedup is 11.70 [must-gather ] OUT 2026-07-31T10:07:54.252133406Z namespace/openshift-must-gather-qxggr deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 8253d403-dfb0-4440-a057-aeaf510334a5 ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing