[must-gather ] OUT 2026-08-01T06:01:26.977265123Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: e7cb4db8-dcf4-4c49-ad6a-c657cac9debd ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-08-01T06:01:27.025452414Z namespace/openshift-must-gather-bmg8r created [must-gather ] OUT 2026-08-01T06:01:27.029939483Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-9n44c created [must-gather ] OUT 2026-08-01T06:01:27.05009555Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-nbbpw] OUT 2026-08-01T06:02:19.360906755Z waiting for gather to complete [must-gather-nbbpw] OUT 2026-08-01T06:02:19.364437577Z downloading gather output [must-gather-nbbpw] OUT 2026-08-01T06:02:19.61943918Z receiving incremental file list [must-gather-nbbpw] OUT 2026-08-01T06:02:19.630322353Z ./ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.630438136Z aggregated-discovery-api.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.630740014Z aggregated-discovery-apis.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.631837066Z event-filter.html [must-gather-nbbpw] OUT 2026-08-01T06:02:19.631961449Z timestamp [must-gather-nbbpw] OUT 2026-08-01T06:02:19.632084143Z version [must-gather-nbbpw] OUT 2026-08-01T06:02:19.634482422Z namespaces/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.634503933Z namespaces/opendatahub/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.634583955Z namespaces/opendatahub/opendatahub.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.634679118Z namespaces/opendatahub/apps.openshift.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.634731789Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.634795871Z namespaces/opendatahub/apps/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.634853433Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.634951366Z namespaces/opendatahub/apps/deployments.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635058129Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635167482Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635212023Z namespaces/opendatahub/autoscaling/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635270865Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635339697Z namespaces/opendatahub/batch/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635395558Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635520412Z namespaces/opendatahub/batch/jobs.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635559153Z namespaces/opendatahub/build.openshift.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635603974Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635686547Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635733828Z namespaces/opendatahub/core/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635778749Z namespaces/opendatahub/core/configmaps.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.635901873Z namespaces/opendatahub/core/endpoints.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.636009116Z namespaces/opendatahub/core/events.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.636132349Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.636211942Z namespaces/opendatahub/core/pods.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.636364306Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.63648833Z namespaces/opendatahub/core/secrets.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.636668875Z namespaces/opendatahub/core/services.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.636741217Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.636791938Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.63685442Z namespaces/opendatahub/image.openshift.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.636900611Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637010585Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637054616Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637168299Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.63720793Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637250651Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637314123Z namespaces/opendatahub/networking.k8s.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637378145Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637431197Z namespaces/opendatahub/pods/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637440057Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637489538Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637583541Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq/manager/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637591791Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq/manager/manager/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637595911Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq/manager/manager/logs/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637636692Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq/manager/manager/logs/current.insecure.log [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637727175Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq/manager/manager/logs/current.log [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637799197Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq/manager/manager/logs/previous.insecure.log [must-gather-nbbpw] OUT 2026-08-01T06:02:19.63789184Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq/manager/manager/logs/previous.log [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637921281Z namespaces/opendatahub/policy/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.637979092Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638035874Z namespaces/opendatahub/route.openshift.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638085625Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638143287Z namespaces/openshift/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638196559Z namespaces/openshift/openshift.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638260661Z namespaces/openshift/apps.openshift.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638330912Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638379764Z namespaces/openshift/apps/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638471856Z namespaces/openshift/apps/daemonsets.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638571839Z namespaces/openshift/apps/deployments.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638672952Z namespaces/openshift/apps/replicasets.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638754345Z namespaces/openshift/apps/statefulsets.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638812346Z namespaces/openshift/autoscaling/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638852358Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638911879Z namespaces/openshift/batch/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.638960321Z namespaces/openshift/batch/cronjobs.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639058263Z namespaces/openshift/batch/jobs.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639106595Z namespaces/openshift/build.openshift.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639157256Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639251649Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639323291Z namespaces/openshift/core/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639374333Z namespaces/openshift/core/configmaps.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639509856Z namespaces/openshift/core/endpoints.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639595049Z namespaces/openshift/core/events.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639688262Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639787374Z namespaces/openshift/core/pods.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.639873367Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.640032421Z namespaces/openshift/core/secrets.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.640212486Z namespaces/openshift/core/services.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.640269618Z namespaces/openshift/discovery.k8s.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.64033844Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.640402622Z namespaces/openshift/image.openshift.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.640438473Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.642011278Z namespaces/openshift/k8s.ovn.org/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.642047419Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.642127441Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.642173993Z namespaces/openshift/monitoring.coreos.com/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.642205414Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.642261115Z namespaces/openshift/networking.k8s.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.642313587Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.642384659Z namespaces/openshift/policy/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.64242413Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.642479382Z namespaces/openshift/route.openshift.io/ [must-gather-nbbpw] OUT 2026-08-01T06:02:19.642519113Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-nbbpw] OUT 2026-08-01T06:02:19.649149793Z [must-gather-nbbpw] OUT 2026-08-01T06:02:19.649167594Z sent 1,391 bytes received 64,270 bytes 131,322.00 bytes/sec [must-gather-nbbpw] OUT 2026-08-01T06:02:19.649173324Z total size is 801,138 speedup is 12.20 [must-gather ] OUT 2026-08-01T06:02:19.677826927Z namespace/openshift-must-gather-bmg8r deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: e7cb4db8-dcf4-4c49-ad6a-c657cac9debd ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing