[must-gather ] OUT 2026-07-28T07:59:42.416962266Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: fa1eceec-0c2e-4772-8f2a-3bce2c080a70 ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-28T07:59:42.473160422Z namespace/openshift-must-gather-8vhwv created [must-gather ] OUT 2026-07-28T07:59:42.482538209Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-hp47q created [must-gather ] OUT 2026-07-28T07:59:42.502446527Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-wj4qv] OUT 2026-07-28T08:00:36.134596178Z waiting for gather to complete [must-gather-wj4qv] OUT 2026-07-28T08:00:36.137995102Z downloading gather output [must-gather-wj4qv] OUT 2026-07-28T08:00:36.453931524Z receiving incremental file list [must-gather-wj4qv] OUT 2026-07-28T08:00:36.466462969Z ./ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.466541911Z aggregated-discovery-api.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.466833479Z aggregated-discovery-apis.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.467394955Z event-filter.html [must-gather-wj4qv] OUT 2026-07-28T08:00:36.467512628Z timestamp [must-gather-wj4qv] OUT 2026-07-28T08:00:36.467630201Z version [must-gather-wj4qv] OUT 2026-07-28T08:00:36.471332333Z namespaces/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.471347533Z namespaces/opendatahub/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.471449696Z namespaces/opendatahub/opendatahub.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.471557469Z namespaces/opendatahub/apps.openshift.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.47160366Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.471660142Z namespaces/opendatahub/apps/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.471705033Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.471824577Z namespaces/opendatahub/apps/deployments.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.47195671Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472085314Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472129505Z namespaces/opendatahub/autoscaling/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472193307Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472228598Z namespaces/opendatahub/batch/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472263259Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472356591Z namespaces/opendatahub/batch/jobs.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472399213Z namespaces/opendatahub/build.openshift.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472443424Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472525776Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472567947Z namespaces/opendatahub/core/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472618459Z namespaces/opendatahub/core/configmaps.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472751622Z namespaces/opendatahub/core/endpoints.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472862625Z namespaces/opendatahub/core/events.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.472990189Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.473071541Z namespaces/opendatahub/core/pods.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.473211795Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.473358269Z namespaces/opendatahub/core/secrets.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.473548044Z namespaces/opendatahub/core/services.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.473606036Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.473662827Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.473708009Z namespaces/opendatahub/image.openshift.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.47375527Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.473884663Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.473930375Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474020677Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474059338Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474094109Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474151061Z namespaces/opendatahub/networking.k8s.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474180522Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474236013Z namespaces/opendatahub/pods/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474243283Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474294705Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474387097Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm/manager/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474398748Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm/manager/manager/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474403928Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm/manager/manager/logs/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.474433618Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm/manager/manager/logs/current.log [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476407003Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm/manager/manager/logs/previous.insecure.log [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476469084Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm/manager/manager/logs/previous.log [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476516696Z namespaces/opendatahub/policy/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476550367Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476602638Z namespaces/opendatahub/route.openshift.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476645929Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476696091Z namespaces/openshift/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476740512Z namespaces/openshift/openshift.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476821804Z namespaces/openshift/apps.openshift.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476859055Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476907797Z namespaces/openshift/apps/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.476943658Z namespaces/openshift/apps/daemonsets.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.47703222Z namespaces/openshift/apps/deployments.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477124012Z namespaces/openshift/apps/replicasets.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477206095Z namespaces/openshift/apps/statefulsets.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477254166Z namespaces/openshift/autoscaling/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477306417Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477342358Z namespaces/openshift/batch/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.47738443Z namespaces/openshift/batch/cronjobs.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477462302Z namespaces/openshift/batch/jobs.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477513073Z namespaces/openshift/build.openshift.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477544614Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477637157Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477681888Z namespaces/openshift/core/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477718139Z namespaces/openshift/core/configmaps.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477849372Z namespaces/openshift/core/endpoints.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.477927125Z namespaces/openshift/core/events.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.478009347Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.478092029Z namespaces/openshift/core/pods.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.478170401Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.478302135Z namespaces/openshift/core/secrets.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.47847352Z namespaces/openshift/core/services.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.47850903Z namespaces/openshift/discovery.k8s.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.478563102Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.478610403Z namespaces/openshift/image.openshift.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.478667245Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.480127005Z namespaces/openshift/k8s.ovn.org/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.480180127Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.480262849Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.48030277Z namespaces/openshift/monitoring.coreos.com/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.480340031Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.480395932Z namespaces/openshift/networking.k8s.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.480427273Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.480467914Z namespaces/openshift/policy/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.480518266Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.480589718Z namespaces/openshift/route.openshift.io/ [must-gather-wj4qv] OUT 2026-07-28T08:00:36.480633889Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-wj4qv] OUT 2026-07-28T08:00:36.488795764Z [must-gather-wj4qv] OUT 2026-07-28T08:00:36.488821204Z sent 1,376 bytes received 101,665 bytes 206,082.00 bytes/sec [must-gather-wj4qv] OUT 2026-07-28T08:00:36.488827664Z total size is 1,321,248 speedup is 12.82 [must-gather ] OUT 2026-07-28T08:00:36.520876916Z namespace/openshift-must-gather-8vhwv deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: fa1eceec-0c2e-4772-8f2a-3bce2c080a70 ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing