[must-gather ] OUT 2026-07-08T22:31:29.397479485Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: e355e740-7bd6-44fa-bc43-00ea4233258f ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.23" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-08T22:31:29.452975086Z namespace/openshift-must-gather-2pn59 created [must-gather ] OUT 2026-07-08T22:31:29.460824652Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-n28r2 created [must-gather ] OUT 2026-07-08T22:31:29.485433862Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-s6hjb] OUT 2026-07-08T22:32:28.390503236Z waiting for gather to complete [must-gather-s6hjb] OUT 2026-07-08T22:32:28.393477102Z downloading gather output [must-gather-s6hjb] OUT 2026-07-08T22:32:28.672910569Z receiving incremental file list [must-gather-s6hjb] OUT 2026-07-08T22:32:28.68546595Z ./ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.685553672Z aggregated-discovery-api.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.68789098Z aggregated-discovery-apis.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.688665612Z event-filter.html [must-gather-s6hjb] OUT 2026-07-08T22:32:28.688748734Z timestamp [must-gather-s6hjb] OUT 2026-07-08T22:32:28.688875168Z version [must-gather-s6hjb] OUT 2026-07-08T22:32:28.690298239Z namespaces/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.690313979Z namespaces/opendatahub/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69036054Z namespaces/opendatahub/opendatahub.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.690458473Z namespaces/opendatahub/apps.openshift.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.690506245Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.690554486Z namespaces/opendatahub/apps/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.690593537Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69068088Z namespaces/opendatahub/apps/deployments.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.690799633Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.690911146Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.690951548Z namespaces/opendatahub/autoscaling/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.690992379Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69104437Z namespaces/opendatahub/batch/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691087071Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691163563Z namespaces/opendatahub/batch/jobs.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691211225Z namespaces/opendatahub/build.openshift.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691264317Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691361189Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.6913972Z namespaces/opendatahub/core/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691455172Z namespaces/opendatahub/core/configmaps.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691572505Z namespaces/opendatahub/core/endpoints.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691658598Z namespaces/opendatahub/core/events.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691780101Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691859283Z namespaces/opendatahub/core/pods.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.691999147Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692125211Z namespaces/opendatahub/core/secrets.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692299266Z namespaces/opendatahub/core/services.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692352038Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69242414Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692474691Z namespaces/opendatahub/image.openshift.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692525563Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692626206Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692665477Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692757369Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692803111Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692832222Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692888193Z namespaces/opendatahub/networking.k8s.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692919054Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692972935Z namespaces/opendatahub/pods/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.692980636Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-cwt6j/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693034547Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-cwt6j/kubeflow-trainer-controller-manager-857f77d56c-cwt6j.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693254414Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-cwt6j/manager/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693262124Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-cwt6j/manager/manager/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693266894Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-cwt6j/manager/manager/logs/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693297275Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-cwt6j/manager/manager/logs/current.log [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69348028Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-cwt6j/manager/manager/logs/previous.insecure.log [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693559612Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-cwt6j/manager/manager/logs/previous.log [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693575333Z namespaces/opendatahub/policy/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693612044Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693671606Z namespaces/opendatahub/route.openshift.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693711037Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693761278Z namespaces/openshift/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69380237Z namespaces/openshift/openshift.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693859191Z namespaces/openshift/apps.openshift.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693896922Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693938273Z namespaces/openshift/apps/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.693981955Z namespaces/openshift/apps/daemonsets.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694274403Z namespaces/openshift/apps/deployments.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694295884Z namespaces/openshift/apps/replicasets.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694302134Z namespaces/openshift/apps/statefulsets.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694314294Z namespaces/openshift/autoscaling/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694326125Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694379996Z namespaces/openshift/batch/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694415847Z namespaces/openshift/batch/cronjobs.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694545061Z namespaces/openshift/batch/jobs.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694575562Z namespaces/openshift/build.openshift.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694613463Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694696365Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.694742337Z namespaces/openshift/core/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.695146768Z namespaces/openshift/core/configmaps.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.695533839Z namespaces/openshift/core/endpoints.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69554855Z namespaces/openshift/core/events.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69555377Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69555787Z namespaces/openshift/core/pods.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69556548Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69556943Z namespaces/openshift/core/secrets.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.695575301Z namespaces/openshift/core/services.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.695627772Z namespaces/openshift/discovery.k8s.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.695652523Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.695705734Z namespaces/openshift/image.openshift.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.695740975Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.697266079Z namespaces/openshift/k8s.ovn.org/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69730206Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.697413513Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.697455855Z namespaces/openshift/monitoring.coreos.com/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.697496116Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.697544517Z namespaces/openshift/networking.k8s.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.697583158Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.69762868Z namespaces/openshift/policy/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.697670391Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.697720402Z namespaces/openshift/route.openshift.io/ [must-gather-s6hjb] OUT 2026-07-08T22:32:28.697756513Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-s6hjb] OUT 2026-07-08T22:32:28.7056467Z [must-gather-s6hjb] OUT 2026-07-08T22:32:28.705673701Z sent 1,372 bytes received 70,121 bytes 142,986.00 bytes/sec [must-gather-s6hjb] OUT 2026-07-08T22:32:28.705681651Z total size is 824,745 speedup is 11.54 [must-gather ] OUT 2026-07-08T22:32:28.735130958Z namespace/openshift-must-gather-2pn59 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: e355e740-7bd6-44fa-bc43-00ea4233258f ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.23" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing