[must-gather ] OUT 2026-04-17T14:55:16.849929165Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 845eddb5-dce2-4bad-a922-128efd18f910 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-17T14:55:16.901016674Z namespace/openshift-must-gather-twf9t created [must-gather ] OUT 2026-04-17T14:55:16.908025124Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-scpwt created [must-gather ] OUT 2026-04-17T14:55:16.932524705Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-trkgq] OUT 2026-04-17T14:56:06.6162019Z waiting for gather to complete [must-gather-trkgq] OUT 2026-04-17T14:56:06.618894773Z downloading gather output [must-gather-trkgq] OUT 2026-04-17T14:56:06.89249624Z receiving incremental file list [must-gather-trkgq] OUT 2026-04-17T14:56:06.903704555Z ./ [must-gather-trkgq] OUT 2026-04-17T14:56:06.903827038Z aggregated-discovery-api.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.90425768Z aggregated-discovery-apis.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.904818265Z event-filter.html [must-gather-trkgq] OUT 2026-04-17T14:56:06.904927198Z timestamp [must-gather-trkgq] OUT 2026-04-17T14:56:06.905035571Z version [must-gather-trkgq] OUT 2026-04-17T14:56:06.907443286Z namespaces/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.907463957Z namespaces/opendatahub/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.907505668Z namespaces/opendatahub/opendatahub.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.90758779Z namespaces/opendatahub/apps.openshift.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.907622171Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.907694753Z namespaces/opendatahub/apps/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.907747615Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.907842507Z namespaces/opendatahub/apps/deployments.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.907970901Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.908102014Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.908149926Z namespaces/opendatahub/autoscaling/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.908196947Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.908232708Z namespaces/opendatahub/batch/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.908279479Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.908353751Z namespaces/opendatahub/batch/jobs.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.908398962Z namespaces/opendatahub/build.openshift.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.908434183Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.908512645Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.908552746Z namespaces/opendatahub/core/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.908590998Z namespaces/opendatahub/core/configmaps.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.908711841Z namespaces/opendatahub/core/endpoints.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.908800593Z namespaces/opendatahub/core/events.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.908930447Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.909008309Z namespaces/opendatahub/core/pods.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.909155243Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.909274826Z namespaces/opendatahub/core/secrets.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.909439341Z namespaces/opendatahub/core/services.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.909492732Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.909534533Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.909584494Z namespaces/opendatahub/image.openshift.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.909624426Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.909689697Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.909728969Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.909809191Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.909858192Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.909910674Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.909943124Z namespaces/opendatahub/networking.k8s.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.909984496Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.910030877Z namespaces/opendatahub/pods/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.910039847Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-6mnbs/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.910117149Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-6mnbs/kubeflow-trainer-controller-manager-55f5694779-6mnbs.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.910188471Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-6mnbs/manager/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.910209631Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-6mnbs/manager/manager/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.910213302Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-6mnbs/manager/manager/logs/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.910221552Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-6mnbs/manager/manager/logs/current.log [must-gather-trkgq] OUT 2026-04-17T14:56:06.910585032Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-6mnbs/manager/manager/logs/previous.insecure.log [must-gather-trkgq] OUT 2026-04-17T14:56:06.910653443Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-6mnbs/manager/manager/logs/previous.log [must-gather-trkgq] OUT 2026-04-17T14:56:06.910693215Z namespaces/opendatahub/policy/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.910729906Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.910773047Z namespaces/opendatahub/route.openshift.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.910807568Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.910855969Z namespaces/openshift/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.91090014Z namespaces/openshift/openshift.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.910948971Z namespaces/openshift/apps.openshift.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.910990733Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.911035024Z namespaces/openshift/apps/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.911099696Z namespaces/openshift/apps/daemonsets.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.911185448Z namespaces/openshift/apps/deployments.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.91126116Z namespaces/openshift/apps/replicasets.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.911338182Z namespaces/openshift/apps/statefulsets.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.911384203Z namespaces/openshift/autoscaling/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.911436195Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.911471716Z namespaces/openshift/batch/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.911507797Z namespaces/openshift/batch/cronjobs.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.911587359Z namespaces/openshift/batch/jobs.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.91162281Z namespaces/openshift/build.openshift.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.911664001Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.911741223Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.911799345Z namespaces/openshift/core/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.911819725Z namespaces/openshift/core/configmaps.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.911918698Z namespaces/openshift/core/endpoints.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.91199114Z namespaces/openshift/core/events.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.912091293Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.912179045Z namespaces/openshift/core/pods.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.912254837Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.91237235Z namespaces/openshift/core/secrets.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.912548055Z namespaces/openshift/core/services.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.912571756Z namespaces/openshift/discovery.k8s.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.912615607Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.912666528Z namespaces/openshift/image.openshift.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.912706619Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.914011305Z namespaces/openshift/k8s.ovn.org/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.914052246Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.914160279Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.91419523Z namespaces/openshift/monitoring.coreos.com/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.914245671Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.914295053Z namespaces/openshift/networking.k8s.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.914338464Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.914379685Z namespaces/openshift/policy/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.914427316Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.914467607Z namespaces/openshift/route.openshift.io/ [must-gather-trkgq] OUT 2026-04-17T14:56:06.914509328Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-trkgq] OUT 2026-04-17T14:56:06.921470728Z [must-gather-trkgq] OUT 2026-04-17T14:56:06.921493638Z sent 1,372 bytes received 76,347 bytes 155,438.00 bytes/sec [must-gather-trkgq] OUT 2026-04-17T14:56:06.921501918Z total size is 917,362 speedup is 11.80 [must-gather ] OUT 2026-04-17T14:56:06.950311812Z namespace/openshift-must-gather-twf9t deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 845eddb5-dce2-4bad-a922-128efd18f910 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing