[must-gather ] OUT 2026-08-01T03:58:29.450043833Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 00bc33b9-667f-45b6-b238-7c5d151e2f08 ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-08-01T03:58:29.519506564Z namespace/openshift-must-gather-bl8pg created [must-gather ] OUT 2026-08-01T03:58:29.528109768Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-pmcmd created [must-gather ] OUT 2026-08-01T03:58:29.561629044Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-5rflm] OUT 2026-08-01T03:59:22.804808545Z waiting for gather to complete [must-gather-5rflm] OUT 2026-08-01T03:59:22.808029861Z downloading gather output [must-gather-5rflm] OUT 2026-08-01T03:59:23.093701354Z receiving incremental file list [must-gather-5rflm] OUT 2026-08-01T03:59:23.105318609Z ./ [must-gather-5rflm] OUT 2026-08-01T03:59:23.10538215Z aggregated-discovery-api.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.105763197Z aggregated-discovery-apis.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.106756407Z event-filter.html [must-gather-5rflm] OUT 2026-08-01T03:59:23.106965031Z timestamp [must-gather-5rflm] OUT 2026-08-01T03:59:23.107051653Z version [must-gather-5rflm] OUT 2026-08-01T03:59:23.109266228Z namespaces/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.109284508Z namespaces/opendatahub/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.109328429Z namespaces/opendatahub/opendatahub.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.10938369Z namespaces/opendatahub/apps.openshift.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.109439471Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.109486952Z namespaces/opendatahub/apps/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.109521393Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.109604465Z namespaces/opendatahub/apps/deployments.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.109771168Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.109914051Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.109956452Z namespaces/opendatahub/autoscaling/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.110011663Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.110058904Z namespaces/opendatahub/batch/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.110102825Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.110182826Z namespaces/opendatahub/batch/jobs.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.110233027Z namespaces/opendatahub/build.openshift.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.110254228Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.11035749Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.110404091Z namespaces/opendatahub/core/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.110434821Z namespaces/opendatahub/core/configmaps.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.110575194Z namespaces/opendatahub/core/endpoints.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.110657506Z namespaces/opendatahub/core/events.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.110962152Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.111038953Z namespaces/opendatahub/core/pods.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.111201127Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.111317469Z namespaces/opendatahub/core/secrets.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.111488033Z namespaces/opendatahub/core/services.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.111548984Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.111586284Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.111641026Z namespaces/opendatahub/image.openshift.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.111670896Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.111817899Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.11183883Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.111950222Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.111996613Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.112018693Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.112080374Z namespaces/opendatahub/networking.k8s.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.112107215Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.112166926Z namespaces/opendatahub/pods/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.112174756Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-m65gs/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.112206327Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-m65gs/kubeflow-trainer-controller-manager-679c94ffcd-m65gs.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.112298959Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-m65gs/manager/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.112307779Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-m65gs/manager/manager/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.112311889Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-m65gs/manager/manager/logs/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.11235065Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-m65gs/manager/manager/logs/current.insecure.log [must-gather-5rflm] OUT 2026-08-01T03:59:23.112428772Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-m65gs/manager/manager/logs/current.log [must-gather-5rflm] OUT 2026-08-01T03:59:23.112489703Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-m65gs/manager/manager/logs/previous.insecure.log [must-gather-5rflm] OUT 2026-08-01T03:59:23.112565914Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-m65gs/manager/manager/logs/previous.log [must-gather-5rflm] OUT 2026-08-01T03:59:23.112597035Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-t75c7/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.112634036Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-t75c7/kubeflow-trainer-controller-manager-7b4fcbc79d-t75c7.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.112719047Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-t75c7/manager/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.112743278Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-t75c7/manager/manager/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.112751978Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-t75c7/manager/manager/logs/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.112787329Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-t75c7/manager/manager/logs/current.log [must-gather-5rflm] OUT 2026-08-01T03:59:23.113176596Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-t75c7/manager/manager/logs/previous.insecure.log [must-gather-5rflm] OUT 2026-08-01T03:59:23.113242578Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-t75c7/manager/manager/logs/previous.log [must-gather-5rflm] OUT 2026-08-01T03:59:23.113275209Z namespaces/opendatahub/policy/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.113307219Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.1133662Z namespaces/opendatahub/route.openshift.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.113387271Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.113453672Z namespaces/openshift/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.113500893Z namespaces/openshift/openshift.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.113551054Z namespaces/openshift/apps.openshift.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.113592645Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.113658746Z namespaces/openshift/apps/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.113699097Z namespaces/openshift/apps/daemonsets.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.113816799Z namespaces/openshift/apps/deployments.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.113895541Z namespaces/openshift/apps/replicasets.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.113975312Z namespaces/openshift/apps/statefulsets.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114015143Z namespaces/openshift/autoscaling/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.114051654Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114103075Z namespaces/openshift/batch/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.114142846Z namespaces/openshift/batch/cronjobs.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114243058Z namespaces/openshift/batch/jobs.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114274369Z namespaces/openshift/build.openshift.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.11432629Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114402171Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114448332Z namespaces/openshift/core/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.114491283Z namespaces/openshift/core/configmaps.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114605345Z namespaces/openshift/core/endpoints.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114698807Z namespaces/openshift/core/events.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114802899Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114904171Z namespaces/openshift/core/pods.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.114980883Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.115111806Z namespaces/openshift/core/secrets.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.11530723Z namespaces/openshift/core/services.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.11535463Z namespaces/openshift/discovery.k8s.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.115406552Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.115449452Z namespaces/openshift/image.openshift.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.115497473Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.117118496Z namespaces/openshift/k8s.ovn.org/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.117156657Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.117243018Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.117262609Z namespaces/openshift/monitoring.coreos.com/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.11731766Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.117364081Z namespaces/openshift/networking.k8s.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.117403832Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.117459223Z namespaces/openshift/policy/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.117482043Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.117534694Z namespaces/openshift/route.openshift.io/ [must-gather-5rflm] OUT 2026-08-01T03:59:23.117553075Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-5rflm] OUT 2026-08-01T03:59:23.12374576Z [must-gather-5rflm] OUT 2026-08-01T03:59:23.12376868Z sent 1,483 bytes received 80,837 bytes 54,880.00 bytes/sec [must-gather-5rflm] OUT 2026-08-01T03:59:23.12377394Z total size is 1,027,775 speedup is 12.49 [must-gather ] OUT 2026-08-01T03:59:23.157950828Z namespace/openshift-must-gather-bl8pg deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 00bc33b9-667f-45b6-b238-7c5d151e2f08 ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing