[must-gather ] OUT 2026-07-28T16:48:02.651667851Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: ad50824c-2036-4f06-9b34-610db03ab00a ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-28T16:48:02.715355755Z namespace/openshift-must-gather-7grst created [must-gather ] OUT 2026-07-28T16:48:02.72447266Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-62q7j created [must-gather ] OUT 2026-07-28T16:48:02.752380787Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-2svq2] OUT 2026-07-28T16:48:56.735323051Z waiting for gather to complete [must-gather-2svq2] OUT 2026-07-28T16:48:56.738199214Z downloading gather output [must-gather-2svq2] OUT 2026-07-28T16:48:57.014683456Z receiving incremental file list [must-gather-2svq2] OUT 2026-07-28T16:48:57.025708588Z ./ [must-gather-2svq2] OUT 2026-07-28T16:48:57.025785283Z aggregated-discovery-api.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.026113042Z aggregated-discovery-apis.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.026985905Z event-filter.html [must-gather-2svq2] OUT 2026-07-28T16:48:57.027131634Z timestamp [must-gather-2svq2] OUT 2026-07-28T16:48:57.027249061Z version [must-gather-2svq2] OUT 2026-07-28T16:48:57.03157185Z namespaces/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.031592781Z namespaces/opendatahub/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.031620103Z namespaces/opendatahub/opendatahub.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.031700978Z namespaces/opendatahub/apps.openshift.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.031747701Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.031805084Z namespaces/opendatahub/apps/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.031823935Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.031920501Z namespaces/opendatahub/apps/deployments.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.03206895Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.032180927Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.032220879Z namespaces/opendatahub/autoscaling/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.032267942Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.032308564Z namespaces/opendatahub/batch/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.032345867Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.032433892Z namespaces/opendatahub/batch/jobs.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.032477255Z namespaces/opendatahub/build.openshift.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.032518897Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.032609162Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.032664746Z namespaces/opendatahub/core/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.032684197Z namespaces/opendatahub/core/configmaps.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.032837066Z namespaces/opendatahub/core/endpoints.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.032921981Z namespaces/opendatahub/core/events.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.03307021Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.033154255Z namespaces/opendatahub/core/pods.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.033284493Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.033418581Z namespaces/opendatahub/core/secrets.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.033619273Z namespaces/opendatahub/core/services.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.033684777Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.033719239Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.033790173Z namespaces/opendatahub/image.openshift.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.033828505Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.033939962Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.033974294Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.034091721Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.034139354Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.034168316Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.034226509Z namespaces/opendatahub/networking.k8s.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.034274122Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.034311654Z namespaces/opendatahub/pods/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.034321295Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-f798f6db9-l5bfz/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.034366608Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-f798f6db9-l5bfz/kubeflow-trainer-controller-manager-f798f6db9-l5bfz.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.034458183Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-f798f6db9-l5bfz/manager/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.034468754Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-f798f6db9-l5bfz/manager/manager/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.034474244Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-f798f6db9-l5bfz/manager/manager/logs/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.034508706Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-f798f6db9-l5bfz/manager/manager/logs/current.log [must-gather-2svq2] OUT 2026-07-28T16:48:57.036490525Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-f798f6db9-l5bfz/manager/manager/logs/previous.insecure.log [must-gather-2svq2] OUT 2026-07-28T16:48:57.03655884Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-f798f6db9-l5bfz/manager/manager/logs/previous.log [must-gather-2svq2] OUT 2026-07-28T16:48:57.036587061Z namespaces/opendatahub/policy/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.036636964Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.036670316Z namespaces/opendatahub/route.openshift.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.03672576Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.036770622Z namespaces/openshift/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.036792714Z namespaces/openshift/openshift.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.0368883Z namespaces/openshift/apps.openshift.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.036909891Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.036973845Z namespaces/openshift/apps/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.036995256Z namespaces/openshift/apps/daemonsets.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.037117693Z namespaces/openshift/apps/deployments.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.037204359Z namespaces/openshift/apps/replicasets.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.037277623Z namespaces/openshift/apps/statefulsets.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.037320095Z namespaces/openshift/autoscaling/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.037349087Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.037407171Z namespaces/openshift/batch/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.037435182Z namespaces/openshift/batch/cronjobs.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.037522658Z namespaces/openshift/batch/jobs.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.03756569Z namespaces/openshift/build.openshift.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.037600902Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.037688317Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.037744581Z namespaces/openshift/core/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.037799214Z namespaces/openshift/core/configmaps.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.037921651Z namespaces/openshift/core/endpoints.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.038002166Z namespaces/openshift/core/events.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.038113513Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.038207729Z namespaces/openshift/core/pods.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.038277843Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.038411851Z namespaces/openshift/core/secrets.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.038577621Z namespaces/openshift/core/services.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.038628124Z namespaces/openshift/discovery.k8s.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.038671316Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.038718059Z namespaces/openshift/image.openshift.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.038763382Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.040294164Z namespaces/openshift/k8s.ovn.org/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.040329306Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.040422652Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.040465564Z namespaces/openshift/monitoring.coreos.com/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.040508347Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.040550549Z namespaces/openshift/networking.k8s.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.040602312Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.040646485Z namespaces/openshift/policy/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.040682397Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.04073282Z namespaces/openshift/route.openshift.io/ [must-gather-2svq2] OUT 2026-07-28T16:48:57.040759852Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-2svq2] OUT 2026-07-28T16:48:57.047357428Z [must-gather-2svq2] OUT 2026-07-28T16:48:57.047380429Z sent 1,376 bytes received 101,852 bytes 68,818.67 bytes/sec [must-gather-2svq2] OUT 2026-07-28T16:48:57.04738774Z total size is 1,321,378 speedup is 12.80 [must-gather ] OUT 2026-07-28T16:48:57.080543211Z namespace/openshift-must-gather-7grst deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: ad50824c-2036-4f06-9b34-610db03ab00a ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing