[must-gather ] OUT 2026-07-29T15:55:32.412162861Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: b2654cc1-4bd1-49d7-b209-19077f56951d ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-29T15:55:32.461954379Z namespace/openshift-must-gather-spkqg created [must-gather ] OUT 2026-07-29T15:55:32.469602391Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-226z7 created [must-gather ] OUT 2026-07-29T15:55:32.494225524Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-rwjl7] OUT 2026-07-29T15:56:27.243245028Z waiting for gather to complete [must-gather-rwjl7] OUT 2026-07-29T15:56:27.245965529Z downloading gather output [must-gather-rwjl7] OUT 2026-07-29T15:56:27.522403203Z receiving incremental file list [must-gather-rwjl7] OUT 2026-07-29T15:56:27.530792212Z ./ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.530944826Z aggregated-discovery-api.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.533177546Z aggregated-discovery-apis.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.533832201Z event-filter.html [must-gather-rwjl7] OUT 2026-07-29T15:56:27.533939793Z timestamp [must-gather-rwjl7] OUT 2026-07-29T15:56:27.534053536Z version [must-gather-rwjl7] OUT 2026-07-29T15:56:27.536292926Z namespaces/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.536308617Z namespaces/opendatahub/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.536484881Z namespaces/opendatahub/opendatahub.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.536666455Z namespaces/opendatahub/apps.openshift.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.536728856Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.536798578Z namespaces/opendatahub/apps/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.536860749Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.536970362Z namespaces/opendatahub/apps/deployments.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.537125325Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.537263828Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.53732457Z namespaces/opendatahub/autoscaling/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.537398311Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.537453773Z namespaces/opendatahub/batch/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.537494233Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.537582795Z namespaces/opendatahub/batch/jobs.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.537625816Z namespaces/opendatahub/build.openshift.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.537671037Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.537754119Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.53780933Z namespaces/opendatahub/core/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.537870442Z namespaces/opendatahub/core/configmaps.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.538031186Z namespaces/opendatahub/core/endpoints.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.538126388Z namespaces/opendatahub/core/events.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.53824205Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.538383894Z namespaces/opendatahub/core/pods.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.538524767Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.5386649Z namespaces/opendatahub/core/secrets.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.538866134Z namespaces/opendatahub/core/services.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.538949456Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539011818Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539078439Z namespaces/opendatahub/image.openshift.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539143341Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539257363Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539314944Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539449087Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539482638Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.53955702Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539611511Z namespaces/opendatahub/networking.k8s.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539664272Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539732464Z namespaces/opendatahub/pods/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539740424Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539802275Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539912468Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw/manager/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539922728Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw/manager/manager/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539926758Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw/manager/manager/logs/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.539970199Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw/manager/manager/logs/current.log [must-gather-rwjl7] OUT 2026-07-29T15:56:27.540230835Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw/manager/manager/logs/previous.insecure.log [must-gather-rwjl7] OUT 2026-07-29T15:56:27.540318327Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-pfhmw/manager/manager/logs/previous.log [must-gather-rwjl7] OUT 2026-07-29T15:56:27.540365708Z namespaces/opendatahub/policy/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.54045678Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.540511431Z namespaces/opendatahub/route.openshift.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.540576683Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.540629664Z namespaces/openshift/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.540690655Z namespaces/openshift/openshift.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.540756217Z namespaces/openshift/apps.openshift.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.540807678Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.540860089Z namespaces/openshift/apps/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.54091498Z namespaces/openshift/apps/daemonsets.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541032913Z namespaces/openshift/apps/deployments.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541131616Z namespaces/openshift/apps/replicasets.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541229358Z namespaces/openshift/apps/statefulsets.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541277039Z namespaces/openshift/autoscaling/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.54133662Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541411142Z namespaces/openshift/batch/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541459633Z namespaces/openshift/batch/cronjobs.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541567295Z namespaces/openshift/batch/jobs.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541620987Z namespaces/openshift/build.openshift.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541666908Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.54176556Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541825611Z namespaces/openshift/core/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541880062Z namespaces/openshift/core/configmaps.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.541991245Z namespaces/openshift/core/endpoints.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.542092547Z namespaces/openshift/core/events.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.54219182Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.542289852Z namespaces/openshift/core/pods.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.542419225Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.542579478Z namespaces/openshift/core/secrets.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.542770342Z namespaces/openshift/core/services.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.542824544Z namespaces/openshift/discovery.k8s.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.542877795Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.542939696Z namespaces/openshift/image.openshift.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.542982247Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.544818089Z namespaces/openshift/k8s.ovn.org/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.54486515Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.544974022Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.545030304Z namespaces/openshift/monitoring.coreos.com/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.545067914Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.545141926Z namespaces/openshift/networking.k8s.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.545180797Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.545242408Z namespaces/openshift/policy/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.54529841Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.545373661Z namespaces/openshift/route.openshift.io/ [must-gather-rwjl7] OUT 2026-07-29T15:56:27.545425712Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-rwjl7] OUT 2026-07-29T15:56:27.550394054Z [must-gather-rwjl7] OUT 2026-07-29T15:56:27.550430495Z sent 1,372 bytes received 71,092 bytes 144,928.00 bytes/sec [must-gather-rwjl7] OUT 2026-07-29T15:56:27.550441625Z total size is 848,488 speedup is 11.71 [must-gather ] OUT 2026-07-29T15:56:27.579054271Z namespace/openshift-must-gather-spkqg deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: b2654cc1-4bd1-49d7-b209-19077f56951d ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing