[must-gather ] OUT 2026-04-23T09:02:11.947942181Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: e103e9c3-dcb2-448b-8c3c-19d0ae47c478 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-23T09:02:12.001218868Z namespace/openshift-must-gather-qddjf created [must-gather ] OUT 2026-04-23T09:02:12.008697138Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-npjkm created [must-gather ] OUT 2026-04-23T09:02:12.038560313Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-wdgxb] OUT 2026-04-23T09:03:05.372499318Z waiting for gather to complete [must-gather-wdgxb] OUT 2026-04-23T09:03:05.376225728Z downloading gather output [must-gather-wdgxb] OUT 2026-04-23T09:03:05.649786717Z receiving incremental file list [must-gather-wdgxb] OUT 2026-04-23T09:03:05.6606514Z ./ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.660814293Z aggregated-discovery-api.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.661450513Z aggregated-discovery-apis.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.662055822Z event-filter.html [must-gather-wdgxb] OUT 2026-04-23T09:03:05.662169264Z timestamp [must-gather-wdgxb] OUT 2026-04-23T09:03:05.662278536Z version [must-gather-wdgxb] OUT 2026-04-23T09:03:05.665721261Z namespaces/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.665742621Z namespaces/opendatahub/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.665757591Z namespaces/opendatahub/opendatahub.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.665841303Z namespaces/opendatahub/apps.openshift.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.665868393Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.665929354Z namespaces/opendatahub/apps/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.665973115Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666067826Z namespaces/opendatahub/apps/deployments.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666171348Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.66627682Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.66632518Z namespaces/opendatahub/autoscaling/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666363431Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666435652Z namespaces/opendatahub/batch/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666480113Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666564904Z namespaces/opendatahub/batch/jobs.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666596625Z namespaces/opendatahub/build.openshift.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666647655Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666744727Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666791818Z namespaces/opendatahub/core/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666830918Z namespaces/opendatahub/core/configmaps.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.666960051Z namespaces/opendatahub/core/endpoints.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.667038452Z namespaces/opendatahub/core/events.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.667162644Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.667238635Z namespaces/opendatahub/core/pods.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.667364357Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.66753881Z namespaces/opendatahub/core/secrets.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.667731833Z namespaces/opendatahub/core/services.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.667787914Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.667817854Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.667881135Z namespaces/opendatahub/image.openshift.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.667918806Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668013367Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668050868Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668130779Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.66817285Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668217891Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668261401Z namespaces/opendatahub/networking.k8s.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668301762Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668351883Z namespaces/opendatahub/pods/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668358653Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-rh4m6/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668397583Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-rh4m6/kubeflow-trainer-controller-manager-55f5694779-rh4m6.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668507435Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-rh4m6/manager/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668520905Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-rh4m6/manager/manager/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668525416Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-rh4m6/manager/manager/logs/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668561316Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-rh4m6/manager/manager/logs/current.log [must-gather-wdgxb] OUT 2026-04-23T09:03:05.668928652Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-rh4m6/manager/manager/logs/previous.insecure.log [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669004053Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-rh4m6/manager/manager/logs/previous.log [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669046804Z namespaces/opendatahub/policy/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669082464Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669136475Z namespaces/opendatahub/route.openshift.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669167586Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669219096Z namespaces/openshift/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669259567Z namespaces/openshift/openshift.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669319628Z namespaces/openshift/apps.openshift.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669354729Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669403419Z namespaces/openshift/apps/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.6694763Z namespaces/openshift/apps/daemonsets.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669581042Z namespaces/openshift/apps/deployments.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669646073Z namespaces/openshift/apps/replicasets.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669726284Z namespaces/openshift/apps/statefulsets.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669771185Z namespaces/openshift/autoscaling/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669804796Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669857237Z namespaces/openshift/batch/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669898187Z namespaces/openshift/batch/cronjobs.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.669980808Z namespaces/openshift/batch/jobs.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.670021059Z namespaces/openshift/build.openshift.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.67005623Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.670142161Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.670176702Z namespaces/openshift/core/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.670213652Z namespaces/openshift/core/configmaps.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.670325824Z namespaces/openshift/core/endpoints.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.670400125Z namespaces/openshift/core/events.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.670518067Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.670612819Z namespaces/openshift/core/pods.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.67067956Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.670816652Z namespaces/openshift/core/secrets.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.670988575Z namespaces/openshift/core/services.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.671038705Z namespaces/openshift/discovery.k8s.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.671068156Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.671124107Z namespaces/openshift/image.openshift.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.671165687Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.672733243Z namespaces/openshift/k8s.ovn.org/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.672782203Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.672864125Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.672898085Z namespaces/openshift/monitoring.coreos.com/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.672935256Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.672984016Z namespaces/openshift/networking.k8s.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.673021307Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.673068958Z namespaces/openshift/policy/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.673117389Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.673152679Z namespaces/openshift/route.openshift.io/ [must-gather-wdgxb] OUT 2026-04-23T09:03:05.67320339Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-wdgxb] OUT 2026-04-23T09:03:05.678957532Z [must-gather-wdgxb] OUT 2026-04-23T09:03:05.678978162Z sent 1,372 bytes received 75,461 bytes 153,666.00 bytes/sec [must-gather-wdgxb] OUT 2026-04-23T09:03:05.678984872Z total size is 895,077 speedup is 11.65 [must-gather ] OUT 2026-04-23T09:03:05.707905853Z namespace/openshift-must-gather-qddjf deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: e103e9c3-dcb2-448b-8c3c-19d0ae47c478 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing