[must-gather ] OUT 2026-04-16T09:12:40.14958809Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 504e23d7-334d-4d7f-abe8-a9089abaf6e4 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.18" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-16T09:12:40.194356072Z namespace/openshift-must-gather-vqrq2 created [must-gather ] OUT 2026-04-16T09:12:40.199480483Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-qk52p created [must-gather ] OUT 2026-04-16T09:12:40.222630284Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-mr7l5] OUT 2026-04-16T09:13:31.310673389Z waiting for gather to complete [must-gather-mr7l5] OUT 2026-04-16T09:13:31.314100644Z downloading gather output [must-gather-mr7l5] OUT 2026-04-16T09:13:31.572374877Z receiving incremental file list [must-gather-mr7l5] OUT 2026-04-16T09:13:31.58414942Z ./ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.584294375Z aggregated-discovery-api.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.584787891Z aggregated-discovery-apis.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.585388172Z event-filter.html [must-gather-mr7l5] OUT 2026-04-16T09:13:31.585521466Z timestamp [must-gather-mr7l5] OUT 2026-04-16T09:13:31.585666051Z version [must-gather-mr7l5] OUT 2026-04-16T09:13:31.587874805Z namespaces/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.587892495Z namespaces/opendatahub/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.587932026Z namespaces/opendatahub/opendatahub.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588005599Z namespaces/opendatahub/apps.openshift.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.58804223Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588090212Z namespaces/opendatahub/apps/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588138073Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588217856Z namespaces/opendatahub/apps/deployments.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.58833225Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588439483Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588483675Z namespaces/opendatahub/autoscaling/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588513766Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588564087Z namespaces/opendatahub/batch/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588608189Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588682802Z namespaces/opendatahub/batch/jobs.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588726263Z namespaces/opendatahub/build.openshift.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588775505Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588846387Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.58892077Z namespaces/opendatahub/core/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.588973371Z namespaces/opendatahub/core/configmaps.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.589088005Z namespaces/opendatahub/core/endpoints.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.589175058Z namespaces/opendatahub/core/events.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.589289352Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.589368574Z namespaces/opendatahub/core/pods.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.589492769Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.589610273Z namespaces/opendatahub/core/secrets.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.589796209Z namespaces/opendatahub/core/services.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.589872761Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.589914023Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.589977765Z namespaces/opendatahub/image.openshift.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590014606Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590098399Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.59013325Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590214953Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590256614Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590297476Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590328366Z namespaces/opendatahub/networking.k8s.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590390099Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.59042624Z namespaces/opendatahub/pods/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.59043381Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5dgzl/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590476191Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5dgzl/kubeflow-trainer-controller-manager-55f5694779-5dgzl.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590554174Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5dgzl/manager/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590563274Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5dgzl/manager/manager/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590568474Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5dgzl/manager/manager/logs/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590604196Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5dgzl/manager/manager/logs/current.log [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590883695Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5dgzl/manager/manager/logs/previous.insecure.log [must-gather-mr7l5] OUT 2026-04-16T09:13:31.590967538Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5dgzl/manager/manager/logs/previous.log [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591002029Z namespaces/opendatahub/policy/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.59104785Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591091152Z namespaces/opendatahub/route.openshift.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591136413Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591180445Z namespaces/openshift/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591227607Z namespaces/openshift/openshift.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591275478Z namespaces/openshift/apps.openshift.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.59131519Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591359611Z namespaces/openshift/apps/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591397722Z namespaces/openshift/apps/daemonsets.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591474525Z namespaces/openshift/apps/deployments.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591549947Z namespaces/openshift/apps/replicasets.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.59162678Z namespaces/openshift/apps/statefulsets.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591678152Z namespaces/openshift/autoscaling/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591718133Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591761994Z namespaces/openshift/batch/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591802806Z namespaces/openshift/batch/cronjobs.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.59191113Z namespaces/openshift/batch/jobs.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.591968032Z namespaces/openshift/build.openshift.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592010723Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592083005Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592130037Z namespaces/openshift/core/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592153648Z namespaces/openshift/core/configmaps.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592258771Z namespaces/openshift/core/endpoints.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592333154Z namespaces/openshift/core/events.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592408406Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592486909Z namespaces/openshift/core/pods.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592559351Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592673385Z namespaces/openshift/core/secrets.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592833841Z namespaces/openshift/core/services.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592909153Z namespaces/openshift/discovery.k8s.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.592946784Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.593000626Z namespaces/openshift/image.openshift.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.593035517Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.594567178Z namespaces/openshift/k8s.ovn.org/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.594593349Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.594684702Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.594723313Z namespaces/openshift/monitoring.coreos.com/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.594764005Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.594828357Z namespaces/openshift/networking.k8s.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.594847148Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.594941541Z namespaces/openshift/policy/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.594985462Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.595026854Z namespaces/openshift/route.openshift.io/ [must-gather-mr7l5] OUT 2026-04-16T09:13:31.595061635Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-mr7l5] OUT 2026-04-16T09:13:31.601307513Z [must-gather-mr7l5] OUT 2026-04-16T09:13:31.601337125Z sent 1,372 bytes received 73,198 bytes 149,140.00 bytes/sec [must-gather-mr7l5] OUT 2026-04-16T09:13:31.601344955Z total size is 856,302 speedup is 11.48 [must-gather ] OUT 2026-04-16T09:13:31.634934318Z namespace/openshift-must-gather-vqrq2 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 504e23d7-334d-4d7f-abe8-a9089abaf6e4 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.18" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing